-- Logs begin at Thu 2021-12-16 18:06:00 UTC, end at Thu 2021-12-16 21:17:39 UTC. -- Dec 16 18:44:17.574353 n-d-816927-6 systemd[1]: Started Devstack devstack@n-super-cond.service. Dec 16 18:44:20.964975 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:21.187832 n-d-816927-6 nova-conductor[89039]: DEBUG nova.context [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),95157219-854e-48e1-b9a7-81818c76ca64(cell1) {{(pid=89039) load_cells /opt/stack/nova/nova/context.py:465}} Dec 16 18:44:21.191993 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:21.193827 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:21.194818 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:44:21.197324 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89039) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:44:21.228443 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:21.229523 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_db.sqlalchemy.engines [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89039) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:21.244973 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Acquired lock "singleton_lock" {{(pid=89039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:44:21.245979 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_concurrency.lockutils [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Releasing lock "singleton_lock" {{(pid=89039) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:44:21.246856 n-d-816927-6 nova-conductor[89039]: INFO oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Starting 2 workers Dec 16 18:44:21.251710 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Started child 89923 {{(pid=89039) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 18:44:21.256531 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Started child 89924 {{(pid=89039) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} Dec 16 18:44:21.257989 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Full set of CONF: {{(pid=89039) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} Dec 16 18:44:21.259091 n-d-816927-6 nova-conductor[89923]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 18:44:21.259701 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ******************************************************************************** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 16 18:44:21.260174 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] Configuration options gathered from: {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 16 18:44:21.260731 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 16 18:44:21.261680 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] config files: ['/etc/nova/nova.conf'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 16 18:44:21.262152 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ================================================================================ {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 16 18:44:21.263053 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] allow_resize_to_same_host = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.263746 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] arq_binding_timeout = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.264327 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] bandwidth_poll_interval = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.265063 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] bindir = /usr/local/bin {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.265624 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] block_device_allocate_retries = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.266232 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] block_device_allocate_retries_interval = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.266810 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cert = self.pem {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.267353 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute_driver = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.268018 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute_monitors = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.268648 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] config_dir = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.269255 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] config_drive_format = iso9660 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.269731 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] config_file = ['/etc/nova/nova.conf'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.270318 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] config_source = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.270899 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] console_host = n-d-816927-6 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.271646 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] control_exchange = nova {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.272234 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cpu_allocation_ratio = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.272789 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] daemon = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.273484 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] debug = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.274065 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] default_access_ip_network_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.274753 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] default_availability_zone = nova {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.275329 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] default_ephemeral_format = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.276217 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.277829 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] default_schedule_zone = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.278360 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] disk_allocation_ratio = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.278901 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] enable_new_services = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.279571 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] enabled_apis = ['osapi_compute'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.280134 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] enabled_ssl_apis = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.280719 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] flat_injected = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.281283 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] force_config_drive = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.281976 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] force_raw_images = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.282561 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] graceful_shutdown_timeout = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.283091 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] heal_instance_info_cache_interval = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.283949 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] host = n-d-816927-6 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.285027 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] initial_cpu_allocation_ratio = 16.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.285152 n-d-816927-6 nova-conductor[89924]: INFO nova.service [-] Starting conductor node (version 22.3.1) Dec 16 18:44:21.286365 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] initial_disk_allocation_ratio = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.287279 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] initial_ram_allocation_ratio = 1.5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.288400 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.289205 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_build_timeout = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.289870 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_delete_interval = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.290445 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_format = [instance: %(uuid)s] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.291023 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_name_template = instance-%08x {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.291599 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_usage_audit = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.292329 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_usage_audit_period = month {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.292880 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.293473 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] instances_path = /opt/stack/data/nova/instances {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.294037 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] internal_service_availability_zone = internal {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.294629 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] key = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.295340 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] live_migration_retry_count = 30 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.295905 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_config_append = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.296429 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.296950 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_dir = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.297499 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.297978 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_options = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.298358 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_db.sqlalchemy.engines [None req-871b37a4-136a-4b20-9e56-45180ae3781a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:21.298683 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_rotate_interval = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.299340 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_rotate_interval_type = days {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.299943 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] log_rotation_type = none {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.300420 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.300894 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.301448 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.302143 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.302629 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.303199 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] long_rpc_timeout = 1800 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.303757 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_concurrent_builds = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.304301 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_concurrent_live_migrations = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.304840 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_concurrent_snapshots = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.306029 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_local_block_devices = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.307023 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_logfile_count = 30 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.308133 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] max_logfile_size_mb = 200 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.308666 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] maximum_instance_delete_attempts = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.309247 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metadata_listen = 0.0.0.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.309883 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metadata_listen_port = 8775 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.310426 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metadata_workers = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.310950 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] migrate_max_retries = -1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.311513 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] mkisofs_cmd = genisoimage {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.312279 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] my_block_storage_ip = 10.222.0.73 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.312765 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] my_ip = 10.222.0.73 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.313307 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] network_allocate_retries = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.313874 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.314438 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] osapi_compute_listen = 0.0.0.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.314972 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] osapi_compute_listen_port = 8774 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.315694 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] osapi_compute_unique_server_name_scope = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.316258 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] osapi_compute_workers = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.316806 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] password_length = 12 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.317363 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] periodic_enable = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.317898 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] periodic_fuzzy_delay = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.318444 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] pointer_model = usbtablet {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.319016 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] preallocate_images = none {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.319590 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] publish_errors = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.320180 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] pybasedir = /opt/stack/nova {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.320754 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ram_allocation_ratio = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.321864 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rate_limit_burst = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.322546 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rate_limit_except_level = CRITICAL {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.323095 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rate_limit_interval = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.323683 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reboot_timeout = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.324229 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reclaim_instance_interval = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.324759 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] record = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.325324 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] report_interval = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.326063 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rescue_timeout = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.326617 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reserved_host_cpus = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.327157 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reserved_host_disk_mb = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.327737 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reserved_host_memory_mb = 512 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.328334 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] reserved_huge_pages = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.328850 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] resize_confirm_window = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.329384 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] resize_fs_using_block_device = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.329954 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] resume_guests_state_on_host_boot = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.330518 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.331070 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rpc_response_timeout = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.331637 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] run_external_periodic_tasks = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.332202 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] running_deleted_instance_action = reap {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.332837 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] running_deleted_instance_poll_interval = 1800 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.333380 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] running_deleted_instance_timeout = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.333923 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler_instance_sync_interval = 120 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.334496 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_down_time = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.335074 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] servicegroup_driver = db {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.335815 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] shelved_offload_time = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.336445 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] shelved_poll_interval = 3600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.337125 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] shutdown_timeout = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.337689 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] source_is_ipv6 = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.338394 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ssl_only = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.338505 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_db.sqlalchemy.engines [None req-79889fe9-3e10-42b2-baa4-e375feb1b591 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:44:21.339101 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] state_path = /opt/stack/data/nova {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.339715 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] sync_power_state_interval = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.340297 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] sync_power_state_pool_size = 1000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.340841 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] syslog_log_facility = LOG_USER {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.341367 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] tempdir = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.341931 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] timeout_nbd = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.342657 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] transport_url = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.343234 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] update_resources_interval = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.343853 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_cow_images = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.344103 n-d-816927-6 nova-conductor[89923]: DEBUG nova.service [None req-871b37a4-136a-4b20-9e56-45180ae3781a None None] Creating RPC server for service conductor {{(pid=89923) start /opt/stack/nova/nova/service.py:182}} Dec 16 18:44:21.344573 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_eventlog = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.345146 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_journal = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.345680 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_json = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.346333 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_rootwrap_daemon = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.346859 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_stderr = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.347439 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] use_syslog = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.347986 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vcpu_pin_set = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.348545 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vif_plugging_is_fatal = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.349087 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vif_plugging_timeout = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.349694 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] virt_mkfs = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.350254 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] volume_usage_poll_interval = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.350790 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] watch_log_file = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.351522 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] web = /usr/share/spice-html5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 16 18:44:21.352246 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_concurrency.disable_process_locking = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.352946 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.353579 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.auth_strategy = keystone {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.354139 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.compute_link_prefix = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.354718 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.355286 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.dhcp_domain = novalocal {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.355455 n-d-816927-6 nova-conductor[89924]: DEBUG nova.service [None req-79889fe9-3e10-42b2-baa4-e375feb1b591 None None] Creating RPC server for service conductor {{(pid=89924) start /opt/stack/nova/nova/service.py:182}} Dec 16 18:44:21.356116 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.enable_instance_password = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.356654 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.glance_link_prefix = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.357200 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.357779 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.instance_list_cells_batch_strategy = distributed {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.358313 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.instance_list_per_project_cells = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.358866 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.list_records_by_skipping_down_cells = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.359439 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.local_metadata_per_cell = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.360002 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.max_limit = 1000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.360562 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.metadata_cache_expiration = 15 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.361109 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.neutron_default_tenant_id = default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.361645 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.use_forwarded_for = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.362178 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.use_neutron_default_nets = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.362719 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.363411 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_dynamic_failure_fatal = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.363968 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.364529 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_dynamic_ssl_certfile = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.365106 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_dynamic_targets = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.365636 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_jsonfile_path = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.366346 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api.vendordata_providers = ['StaticJSON'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.366989 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.backend = dogpile.cache.memcached {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.367576 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.backend_argument = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.368647 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.config_prefix = cache.oslo {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.369226 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.debug_cache_backend = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.369835 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.enabled = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.370703 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.expiration_time = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.371273 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_dead_retry = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.371881 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.372454 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_pool_maxsize = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.373123 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.373747 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.374323 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.memcache_socket_timeout = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.374891 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.proxies = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.375486 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.tls_allowed_ciphers = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.376065 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.tls_cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.376742 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.tls_certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.377308 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.tls_enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.377869 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cache.tls_keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.378503 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.379107 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.auth_type = password {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.379716 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.380396 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.catalog_info = volumev3::publicURL {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.380974 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.381540 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.382122 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.cross_az_attach = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.382675 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.endpoint_template = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.383936 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.http_retries = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.384578 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.385133 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.385726 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.os_region_name = RegionOne {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.386324 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.387008 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cinder.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.387669 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.388262 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.cpu_dedicated_set = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.388875 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.cpu_shared_set = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.389493 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.live_migration_wait_for_vif_plug = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.390095 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.max_concurrent_disk_ops = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.390731 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.max_disk_devices_to_attach = -1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.391362 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.391986 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.resource_provider_association_refresh = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.392583 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] compute.shutdown_retry_interval = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.393196 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] conductor.workers = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.393929 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] console.allowed_origins = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.394544 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] console.ssl_ciphers = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.395155 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] console.ssl_minimum_version = default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.395787 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] consoleauth.token_ttl = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.396421 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.397117 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.397747 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.398338 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.399081 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.399716 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.400317 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.400918 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.401511 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.402104 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.402713 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.region_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.403317 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.404049 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.service_type = accelerator {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.404651 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.405337 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.405941 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.406527 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.407323 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.407942 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] cyborg.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.408596 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.backend = sqlalchemy {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.409233 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.connection = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.409834 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.connection_debug = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.410448 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.connection_parameters = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.411076 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.connection_recycle_time = 3600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.411697 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.connection_trace = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.412307 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.db_inc_retry_interval = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.412911 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.db_max_retries = 20 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.413523 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.db_max_retry_interval = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.414245 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.db_retry_interval = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.415389 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.max_overflow = 50 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.415997 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.max_pool_size = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.416611 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.max_retries = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.417325 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.mysql_enable_ndb = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.417937 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.418539 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.pool_timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.419142 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.retry_interval = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.419770 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.slave_connection = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.420488 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.sqlite_synchronous = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.421096 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.use_db_reconnect = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.421725 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] database.use_tpool = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.422362 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.connection = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.422970 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.connection_debug = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.423609 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.connection_parameters = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.423899 n-d-816927-6 nova-conductor[89924]: DEBUG nova.service [None req-79889fe9-3e10-42b2-baa4-e375feb1b591 None None] Join ServiceGroup membership for this service conductor {{(pid=89924) start /opt/stack/nova/nova/service.py:199}} Dec 16 18:44:21.424356 n-d-816927-6 nova-conductor[89924]: DEBUG nova.servicegroup.drivers.db [None req-79889fe9-3e10-42b2-baa4-e375feb1b591 None None] DB_Driver: join new ServiceGroup member n-d-816927-6 to the conductor group, service = {{(pid=89924) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 18:44:21.424770 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.connection_recycle_time = 3600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.425375 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.connection_trace = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.425981 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.max_overflow = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.426574 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.max_pool_size = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.427333 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.max_retries = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.428054 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.428648 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.pool_timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.429237 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.retry_interval = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.429819 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.slave_connection = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.430983 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] api_database.sqlite_synchronous = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.431657 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] devices.enabled_vgpu_types = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.432292 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.432883 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ephemeral_storage_encryption.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.433510 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ephemeral_storage_encryption.key_size = 512 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.434151 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.allowed_direct_url_schemes = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.434835 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.api_servers = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.435492 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.436083 n-d-816927-6 nova-conductor[89923]: DEBUG nova.service [None req-871b37a4-136a-4b20-9e56-45180ae3781a None None] Join ServiceGroup membership for this service conductor {{(pid=89923) start /opt/stack/nova/nova/service.py:199}} Dec 16 18:44:21.436327 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.436563 n-d-816927-6 nova-conductor[89923]: DEBUG nova.servicegroup.drivers.db [None req-871b37a4-136a-4b20-9e56-45180ae3781a None None] DB_Driver: join new ServiceGroup member n-d-816927-6 to the conductor group, service = {{(pid=89923) join /opt/stack/nova/nova/servicegroup/drivers/db.py:45}} Dec 16 18:44:21.437161 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.437895 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.438609 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.439231 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.debug = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.439909 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.default_trusted_certificate_ids = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.440519 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.enable_certificate_validation = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.441165 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.enable_rbd_download = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.441766 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.442338 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.442913 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.443516 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.444078 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.444788 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.num_retries = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.445387 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.rbd_ceph_conf = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.446456 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.rbd_connect_timeout = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.447012 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.rbd_pool = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.447704 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.rbd_user = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.448255 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.region_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.448781 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.449332 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.service_type = image {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.449871 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.450413 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.450953 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.451516 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.452079 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.452610 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.verify_glance_signatures = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.453143 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] glance.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.453682 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] guestfs.debug = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.454289 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.config_drive_cdrom = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.454935 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.config_drive_inject_password = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.455500 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.456045 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.enable_instance_metrics_collection = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.456578 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.enable_remotefx = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.457140 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.instances_path_share = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.457786 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.iscsi_initiator_list = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.458337 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.limit_cpu_features = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.458873 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.459432 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.459984 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.power_state_check_timeframe = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.460516 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.power_state_event_polling_interval = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.461061 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.462139 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.use_multipath_io = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.462673 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.volume_attach_retry_count = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.463213 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.volume_attach_retry_interval = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.463768 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.vswitch_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.464301 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.464968 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] mks.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.466207 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.466770 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.manager_interval = 2400 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.467348 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.precache_concurrency = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.468038 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.remove_unused_base_images = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.468600 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.469158 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.469706 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] image_cache.subdirectory_name = _base {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.470274 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.api_max_retries = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.470810 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.api_retry_interval = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.471370 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.471922 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.auth_type = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.472456 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.472981 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.473512 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.474073 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.474597 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.475231 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.475808 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.476355 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.476890 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.477451 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.478121 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.partition_key = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.478655 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.peer_list = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.479193 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.region_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.479758 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.serial_console_state_timeout = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.480295 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.480857 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.service_type = baremetal {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.481387 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.481923 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.482457 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.482985 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.483594 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.484140 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ironic.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.484730 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.485414 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] key_manager.fixed_key = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.486027 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.486566 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.barbican_api_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.487094 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.barbican_endpoint = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.487691 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.barbican_endpoint_type = public {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.488360 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.488983 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.489551 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.490080 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.490607 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.491161 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.number_of_retries = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.491730 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.retry_delay = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.492274 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.492887 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.493423 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.verify_ssl = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.493959 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] barbican.verify_ssl_path = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.494595 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.approle_role_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.495487 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.approle_secret_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.496032 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.496590 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.497363 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.497926 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.498575 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.499121 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.kv_mountpoint = secret {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.499704 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.kv_version = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.500229 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.root_token_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.500784 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.501323 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.ssl_ca_crt_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.501849 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.502380 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.use_ssl = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.502940 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.503538 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.504104 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.504646 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.505184 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.505828 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.506352 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.506894 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.507455 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.507999 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.509136 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.509663 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.region_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.510193 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.510764 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.service_type = identity {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.511333 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.511872 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.512413 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.512938 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.513498 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.514040 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] keystone.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.514675 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.connection_uri = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.515239 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.cpu_mode = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.515894 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.cpu_model_extra_flags = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.516489 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.cpu_models = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.517065 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.disk_cachemodes = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.517591 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.disk_prefix = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.518149 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.enabled_perf_events = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.518701 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.file_backed_memory = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.519351 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.gid_maps = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.519910 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.hw_disk_discard = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.520506 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.hw_machine_type = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.521049 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_rbd_ceph_conf = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.521616 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.522176 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.522716 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_rbd_glance_store_name = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.523274 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_rbd_pool = rbd {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.523856 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_type = default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.524961 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.images_volume_group = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.525524 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.inject_key = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.526181 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.inject_partition = -2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.526728 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.inject_password = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.527285 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.iscsi_iface = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.527836 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.iser_use_multipath = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.528368 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_bandwidth = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.528900 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_completion_timeout = 800 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.529551 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_downtime = 500 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.530087 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_downtime_delay = 75 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.530616 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_downtime_steps = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.531188 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_inbound_addr = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.531751 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_permit_auto_converge = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.532300 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_permit_post_copy = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.532836 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_scheme = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.533409 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_timeout_action = abort {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.533941 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_tunnelled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.534467 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_uri = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.534997 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.live_migration_with_native_tls = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.535578 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.max_queues = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.536215 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.mem_stats_period_seconds = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.536738 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.nfs_mount_options = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.537455 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.537991 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_aoe_discover_tries = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.538935 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_iser_scan_tries = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.539711 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_memory_encrypted_guests = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.540271 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_nvme_discover_tries = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.540803 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_pcie_ports = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.541343 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.num_volume_scan_tries = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.541878 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.pmem_namespaces = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.542444 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.quobyte_client_cfg = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.543111 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.543688 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rbd_connect_timeout = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.544272 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.544837 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.545404 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rbd_secret_uuid = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.545963 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rbd_user = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.546866 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.realtime_scheduler_priority = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.547475 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.remote_filesystem_transport = ssh {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.548056 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rescue_image_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.548608 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rescue_kernel_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.549186 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rescue_ramdisk_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.549874 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rng_dev_path = /dev/urandom {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.550447 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.rx_queue_size = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.551001 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.smbfs_mount_options = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.551707 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.552265 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.snapshot_compression = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.552796 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.snapshot_image_format = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.553435 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.553983 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.sparse_logical_volumes = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.554519 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.swtpm_enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.555081 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.swtpm_group = tss {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.555729 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.swtpm_user = tss {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.556311 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.sysinfo_serial = unique {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.556944 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.tx_queue_size = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.557484 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.uid_maps = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.558024 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.use_usb_tablet = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.558576 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.use_virtio_for_bridges = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.559136 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.virt_type = kvm {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.559867 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.volume_clear = zero {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.560428 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.volume_clear_size = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.560979 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.volume_use_multipath = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.561531 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_cache_path = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.562076 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.562648 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_mount_group = qemu {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.563196 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_mount_opts = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.563760 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.564436 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.565008 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.vzstorage_mount_user = stack {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.565550 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.566109 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] libvirt.xen_hvmloader_path = /usr/lib/xen/boot/hvmloader {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.566823 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.567422 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.auth_type = password {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.567974 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.568501 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.569050 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.569612 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.570244 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.571534 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.default_floating_pool = public {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.572071 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.572612 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.extension_sync_interval = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.573149 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.http_retries = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.573707 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.574250 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.574788 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.575378 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.metadata_proxy_shared_secret = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.575911 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.576471 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.ovs_bridge = br-int {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.577151 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.physnets = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.577708 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.region_name = RegionOne {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.578259 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.service_metadata_proxy = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.578783 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.579379 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.service_type = network {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.580042 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.580587 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.581134 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.581656 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.582222 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.582748 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] neutron.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.583335 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] notifications.bdms_in_notifications = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.583887 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] notifications.default_level = INFO {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.584451 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] notifications.notification_format = unversioned {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.584986 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] notifications.notify_on_state_change = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.585532 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.586102 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] pci.alias = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.587469 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] pci.passthrough_whitelist = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.588064 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.588619 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.auth_type = password {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.589294 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.auth_url = http://10.222.0.73/identity {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.589823 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.590499 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.591038 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.591597 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.connect_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.592128 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.connect_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.592677 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.default_domain_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.593199 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.default_domain_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.593749 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.domain_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.594284 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.domain_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.594816 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.endpoint_override = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.595375 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.595917 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.596538 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.max_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.597065 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.min_version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.597712 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.password = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.598248 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.project_domain_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.598788 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.project_domain_name = Default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.599370 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.project_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.599936 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.project_name = service {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.600576 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.region_name = RegionOne {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.601123 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.service_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.601664 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.service_type = placement {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.602231 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.602767 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.status_code_retries = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.603321 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.status_code_retry_delay = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.603862 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.system_scope = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.604385 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.604907 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.trust_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.605444 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.user_domain_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.605980 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.user_domain_name = Default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.606512 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.user_id = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.607082 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.username = placement {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.607795 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.608346 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] placement.version = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.608912 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] powervm.disk_driver = localdisk {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.609472 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] powervm.proc_units_factor = 0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.610011 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] powervm.volume_group_name = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.610708 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.cores = 20 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.611250 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.count_usage_from_placement = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.611846 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.612407 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.injected_file_content_bytes = 10240 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.612942 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.injected_file_path_length = 255 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.613482 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.injected_files = 5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.614027 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.instances = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.614579 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.key_pairs = 100 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.615128 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.metadata_items = 128 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.615683 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.ram = 51200 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.616216 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.recheck_quota = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.616759 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.server_group_members = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.617315 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] quota.server_groups = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.618140 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rdp.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.618962 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.619590 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.620418 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.driver = filter_scheduler {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.621037 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.621597 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.image_metadata_prefilter = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.622130 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.622670 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.max_attempts = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.623202 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.max_placement_results = 1000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.623752 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.periodic_task_interval = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.624376 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.624909 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.query_placement_for_availability_zone = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.625440 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.query_placement_for_image_type_support = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.625983 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] scheduler.workers = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.626566 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.627150 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.627778 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.628404 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.628958 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.629498 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.630043 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.630875 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.631458 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.host_subset_size = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.631987 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.image_properties_default_architecture = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.632522 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.633093 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.isolated_hosts = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.634153 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.isolated_images = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.634694 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.max_instances_per_host = 50 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.635234 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.635795 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.636335 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.636904 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.637434 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.637965 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.638593 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.639161 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.track_instance_changes = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.639763 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.640305 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metrics.required = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.640967 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metrics.weight_multiplier = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.641500 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metrics.weight_of_unavailable = -10000.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.642043 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] metrics.weight_setting = [] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.642797 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.643362 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.643939 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.port_range = 10000:20000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.644496 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.645044 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.645589 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] serial_console.serialproxy_port = 6083 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.646140 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.646681 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.auth_type = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.647222 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.647777 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.648424 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.649546 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.650078 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.650610 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.send_service_user_token = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.651270 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.651821 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] service_user.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.652381 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.agent_enabled = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.652949 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.653740 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.654379 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.html5proxy_host = 0.0.0.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.654922 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.html5proxy_port = 6082 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.662036 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.server_listen = 127.0.0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.663164 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.663763 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] upgrade_levels.baseapi = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.664315 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] upgrade_levels.cert = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.664903 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] upgrade_levels.compute = auto {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.665443 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] upgrade_levels.conductor = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.666003 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] upgrade_levels.scheduler = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.666572 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.auth_section = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.667113 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.auth_type = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.667698 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.cafile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.668230 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.certfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.668784 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.collect_timing = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.669343 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.669883 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.keyfile = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.670420 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.split_loggers = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.670949 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vendordata_dynamic_auth.timeout = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.671569 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.api_retry_count = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.672231 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.ca_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.672775 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.cache_prefix = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.673303 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.cluster_name = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.673837 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.connection_pool_size = 10 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.674365 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.console_delay_seconds = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.674901 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.datastore_regex = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.675461 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.host_ip = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.676008 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.host_password = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.676559 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.host_port = 443 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.677085 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.host_username = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.677632 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.insecure = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.678172 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.integration_bridge = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.678717 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.maximum_objects = 100 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.679257 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.pbm_default_policy = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.679826 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.pbm_enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.680392 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.pbm_wsdl_location = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.680950 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.681476 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.serial_port_proxy_uri = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.682009 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.serial_port_service_uri = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.682639 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.task_poll_interval = 0.5 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.683203 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.use_linked_clone = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.683771 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.vnc_keymap = en-us {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.684329 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.vnc_port = 5900 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.684906 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vmware.vnc_port_total = 10000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.685522 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.auth_schemes = ['none'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.686061 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.enabled = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.686833 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.687446 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.688042 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.novncproxy_port = 6080 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.688612 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.server_listen = 127.0.0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.689194 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.689731 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.vencrypt_ca_certs = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.690292 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.vencrypt_client_cert = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.690827 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] vnc.vencrypt_client_key = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.691415 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.disable_fallback_pcpu_query = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.691954 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.disable_group_policy_check_upcall = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.692591 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.693143 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.disable_native_luksv1 = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.693820 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.disable_rootwrap = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.694350 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.enable_numa_live_migration = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.694882 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.695444 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.handle_virt_lifecycle_events = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.696504 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.never_download_image_if_on_rbd = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.697060 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.rbd_volume_local_attach = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.697600 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.698176 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.698736 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.client_socket_timeout = 900 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.699272 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.default_pool_size = 1000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.699844 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.keep_alive = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.700382 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.max_header_line = 16384 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.700926 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.secure_proxy_ssl_header = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.701468 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.ssl_ca_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.702009 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.ssl_cert_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.702609 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.ssl_key_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.703236 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.tcp_keepidle = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.707847 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.708276 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] zvm.ca_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.708698 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] zvm.cloud_connector_url = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.709208 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.709611 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] zvm.reachable_timeout = 300 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.710092 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.enforce_new_defaults = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.710496 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.enforce_scope = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.710924 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.policy_default_rule = default {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.711429 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.712360 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.policy_file = policy.yaml {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.712802 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.713207 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.713578 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.713960 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.714344 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.714767 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.715215 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.connection_string = messaging:// {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.715659 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.enabled = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.716075 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.es_doc_type = notification {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.716476 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.es_scroll_size = 10000 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.716872 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.es_scroll_time = 2m {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.717254 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.filter_error_trace = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.717652 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.hmac_keys = SECRET_KEY {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.718045 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.sentinel_service_name = mymaster {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.718455 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.socket_timeout = 0.1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.718840 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] profiler.trace_sqlalchemy = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.719257 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] remote_debug.host = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.719667 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] remote_debug.port = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.720102 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.720494 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.720902 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.721271 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.721665 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.722046 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.722439 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.722847 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.723242 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.723647 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.724046 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.724434 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.724833 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.725222 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.725610 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.726019 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.726402 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.726785 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.727198 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.727619 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.728011 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.728413 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.ssl = False {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.728811 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.729203 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.729603 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.730002 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.730456 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.730846 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_notifications.retry = -1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.731262 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.731696 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.732119 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_reports.file_event_handler = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.732520 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.732923 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] oslo_reports.log_dir = None {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 16 18:44:21.733235 n-d-816927-6 nova-conductor[89039]: DEBUG oslo_service.service [None req-b9b19804-65cc-4379-8dde-2f31e1152b6d None None] ******************************************************************************** {{(pid=89039) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 16 18:47:21.393307 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:47:21.413010 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:47:22.460474 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40300. Dec 16 18:47:22.470151 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40302. Dec 16 18:50:22.445003 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:50:22.454144 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:50:23.473691 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40364. Dec 16 18:50:23.485115 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40366. Dec 16 18:53:23.464903 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:53:23.481744 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 18:53:24.498960 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40456. Dec 16 18:53:24.527868 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40458. Dec 16 18:54:31.203287 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_db.sqlalchemy.engines [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Parent process 89039 forked (89924) with an open database connection, which is being discarded and recreated. {{(pid=89924) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 18:54:33.829688 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Took 2.60 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:33.880228 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:33.884078 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:33.921345 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_db.sqlalchemy.engines [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:54:34.182907 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.186431 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.189874 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.190832 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.232769 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_db.sqlalchemy.engines [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:54:34.289400 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Getting quotas for project 72f2db712f234217a86a5af1830e9f8e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:34.303958 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Getting quotas for user 9bee17467bcc47c9b4d98c5147d684b7 and project 72f2db712f234217a86a5af1830e9f8e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:34.344088 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] [instance: 0db110be-51ed-44a0-90a3-f9961b31e497] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:34.350565 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.351379 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.384506 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] [instance: 0db110be-51ed-44a0-90a3-f9961b31e497] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:34.389554 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.390569 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.512902 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.513616 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.514616 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70f95846-b6ce-4d67-b40f-ee6f06a7903a tempest-AggregatesAdminTestJSON-1116225608 tempest-AggregatesAdminTestJSON-1116225608-project] Acquired lock "compute-rpcapi-router" {{(pid=89924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:54:34.516202 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.516769 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.517997 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:34.518827 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:34.548503 n-d-816927-6 nova-conductor[89924]: INFO nova.compute.rpcapi [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 18:54:34.551215 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6c6a9221-4148-4ad9-bfba-b5a93b4a0208 None None] Releasing lock "compute-rpcapi-router" {{(pid=89924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:54:47.518870 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_db.sqlalchemy.engines [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Parent process 89039 forked (89923) with an open database connection, which is being discarded and recreated. {{(pid=89923) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:403}} Dec 16 18:54:48.558994 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Took 1.01 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:48.637760 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:48.641396 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:48.681891 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_db.sqlalchemy.engines [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:54:48.881079 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:48.883200 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:48.884407 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:48.884963 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:48.936020 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_db.sqlalchemy.engines [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Dec 16 18:54:48.976912 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Getting quotas for project 301c7c6bdd264006a178f14e13533627. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:48.987819 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Getting quotas for user 91dada9d40474fdc926e899c470e22f4 and project 301c7c6bdd264006a178f14e13533627. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:49.007012 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] [instance: d13ee802-f3a2-4718-96f5-ba8046e6f29b] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:49.009580 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:49.010346 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:49.026400 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] [instance: d13ee802-f3a2-4718-96f5-ba8046e6f29b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:49.029559 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:49.029978 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:49.144025 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:49.144561 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:49.145089 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1ed4ce8d-7766-461f-b277-e4e939fd438d tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Acquired lock "compute-rpcapi-router" {{(pid=89923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Dec 16 18:54:49.146360 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:49.146831 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:49.147691 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:49.148108 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:49.159219 n-d-816927-6 nova-conductor[89923]: INFO nova.compute.rpcapi [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Automatically selected compute RPC version 5.12 from minimum service version 53 Dec 16 18:54:49.172483 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0895234d-0346-465c-8f8d-ac92060c5ca9 None None] Releasing lock "compute-rpcapi-router" {{(pid=89923) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Dec 16 18:54:56.174238 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:54:56.219166 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.220322 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:56.331678 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.332245 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:56.335953 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.336618 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:56.373516 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Getting quotas for project 182f2290bee74a79ba9509fa611d1ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:54:56.394883 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Getting quotas for user 4985e5b1f8ad4ac991df6a21ae7c886d and project 182f2290bee74a79ba9509fa611d1ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:54:56.424695 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] [instance: 5e3b60ff-8bb0-4cf1-a0b4-68f7766aa6f3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:54:56.427627 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.428904 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:56.442161 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] [instance: 5e3b60ff-8bb0-4cf1-a0b4-68f7766aa6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:54:56.449403 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.450520 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:54:56.546664 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:54:56.547335 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0490fce5-dffb-48f6-be83-0d2bd61c647c tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.189937 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:11.242280 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.243662 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.344955 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.345590 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.346566 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.347097 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.370893 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:11.377457 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for user 7b048939f46c4eeabe1560e850fd4b58 and project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:11.391248 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 708fb036-3bed-4b21-9fd6-3401a33aa7b9] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:11.392565 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.393110 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.407041 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 708fb036-3bed-4b21-9fd6-3401a33aa7b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:11.408852 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.409482 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:11.470647 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:11.471469 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-38b23249-bf3d-4f05-8e93-cb8597646b5b tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.178042 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:13.264750 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.264750 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.338569 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.339449 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.341112 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.343585 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.366904 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:13.383161 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for user 7b048939f46c4eeabe1560e850fd4b58 and project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:13.407345 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 28fea47f-7f89-42d2-9de3-22b0c8f312ec] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:13.408553 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.409097 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.425501 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 28fea47f-7f89-42d2-9de3-22b0c8f312ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:13.428047 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.428694 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:13.482665 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:13.483125 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9fca9436-6c2d-4917-8b6a-42caf0c8eea9 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:38.947037 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:38.984106 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:38.984889 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:39.044373 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:39.045173 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:39.046740 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:39.047767 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:39.106538 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Getting quotas for project 301c7c6bdd264006a178f14e13533627. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:39.114539 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Getting quotas for user 91dada9d40474fdc926e899c470e22f4 and project 301c7c6bdd264006a178f14e13533627. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:39.133774 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] [instance: 0f6dc941-23a6-4e6d-9fe4-e0f42b53e51f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:39.135147 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:39.136245 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:39.145543 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] [instance: 0f6dc941-23a6-4e6d-9fe4-e0f42b53e51f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:39.147819 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:39.148609 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:39.187857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:39.188518 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-853377fe-7f18-4465-8ebb-22779d5ad2c7 tempest-DeleteServersAdminTestJSON-1262721561 tempest-DeleteServersAdminTestJSON-1262721561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:41.809307 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:41.859022 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:41.859714 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:42.002356 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:42.002751 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:42.003531 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:42.003883 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:42.048955 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:42.065338 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for user d04f30704c1e4507984e8b52df6947f3 and project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:42.094141 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: bc7370da-98f2-4bdc-b8e8-15ddc2cefb15] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:42.095296 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:42.097399 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:42.117670 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: bc7370da-98f2-4bdc-b8e8-15ddc2cefb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:42.119603 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:42.120134 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:42.189596 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:42.190002 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5fb08c8d-a240-456f-ae44-8e462d1ed0c3 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.641738 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:48.699998 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.700407 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.821721 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.822166 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.822989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.823757 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.846439 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Getting quotas for project 4d9d93df860b4fd9a08dd39b7b8a11ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:48.852512 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Getting quotas for user 186fcd40c97c4613a533adc70811260e and project 4d9d93df860b4fd9a08dd39b7b8a11ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:48.868393 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] [instance: 8e735e89-e261-446e-9bac-80114944e3fe] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:48.870754 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.871735 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.881948 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] [instance: 8e735e89-e261-446e-9bac-80114944e3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:48.884349 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.884738 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:48.970486 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:48.971133 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-566a8996-f10b-44a6-a0be-51b8335682d4 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:54.853383 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:55:54.884095 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:54.886062 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:54.979743 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:54.980371 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:54.981339 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:54.981900 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:55.003594 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:55:55.010174 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Getting quotas for user 7b048939f46c4eeabe1560e850fd4b58 and project 5b997f7bb4f04cb9986e909b3b841e9e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:55:55.024783 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 61f15ca2-2305-4e93-98bc-43233c175ab5] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:55:55.026401 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:55.027070 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:55.043376 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 61f15ca2-2305-4e93-98bc-43233c175ab5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:55:55.048029 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:55.048714 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:55:55.119745 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:55:55.120501 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-83667f3d-f1f2-4ef3-bde9-2820851c6793 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:08.124269 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:56:08.125239 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:08.125239 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:09.211196 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] [instance: bc7370da-98f2-4bdc-b8e8-15ddc2cefb15] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:56:10.180619 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Created allocations for migration 74ade327-0ee0-4bcd-abdf-2adbcb5ddd55 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:56:10.462512 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c9b814d3-3f18-4bde-8cac-5d7e108df731 tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] [instance: bc7370da-98f2-4bdc-b8e8-15ddc2cefb15] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:56:24.576423 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Took 0.80 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:24.648009 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:24.649094 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:24.811651 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:24.811651 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:24.811651 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:24.811651 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:24.876157 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:24.890953 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for user f6503b1e840a42abaa0ba2d79dc636d0 and project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:24.930130 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 84550127-960e-4f04-a54f-d79cb76df251] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:24.933160 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:24.933699 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:24.962282 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 84550127-960e-4f04-a54f-d79cb76df251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:24.964091 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:24.964928 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.061699 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.065537 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cf6b867d-30fe-4e68-a228-805896e3f395 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.616105 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:25.659812 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.660857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.757781 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.758633 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.759832 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.760941 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.797981 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Getting quotas for project 4d9d93df860b4fd9a08dd39b7b8a11ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:25.811359 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Getting quotas for user 186fcd40c97c4613a533adc70811260e and project 4d9d93df860b4fd9a08dd39b7b8a11ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:25.831061 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] [instance: 10989df2-d7d5-4d57-95ea-2dce665e60a5] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:25.832714 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.833224 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.845253 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] [instance: 10989df2-d7d5-4d57-95ea-2dce665e60a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:25.848337 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.849194 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:25.938943 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:25.939907 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7b7dcd6c-56b9-4f13-9ed3-f1dd5d2e8305 tempest-LiveMigrationNegativeTest-2146849255 tempest-LiveMigrationNegativeTest-2146849255-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:36.908070 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:56:36.974696 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:36.975539 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:37.071945 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:37.072729 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:37.073742 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:37.075132 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:37.099005 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:56:37.106704 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for user 0fb7f5d24dad4956ba8c305f80928690 and project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:56:37.127528 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 2e47ad01-4dfa-4959-99f5-2cf26290c09f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:56:37.129023 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:37.129711 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:37.148084 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 2e47ad01-4dfa-4959-99f5-2cf26290c09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:56:37.150109 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:37.150814 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:37.237271 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:37.238738 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-43969e28-4ef4-4c46-aa60-9fcd3b49fdad tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:38.790437 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2bf02833-5332-47ed-be0b-518793d4802e tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:56:38.795414 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2bf02833-5332-47ed-be0b-518793d4802e tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:38.798430 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2bf02833-5332-47ed-be0b-518793d4802e tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:38.863683 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2bf02833-5332-47ed-be0b-518793d4802e tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 708fb036-3bed-4b21-9fd6-3401a33aa7b9] No migration record for the rebuild/evacuate request. {{(pid=89923) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:56:52.554217 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:56:52.554217 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:56:52.555204 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:56:53.526471 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Created allocations for migration 5e269471-7bde-4c5e-9d42-332032b8d88c on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:56:54.092430 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 84550127-960e-4f04-a54f-d79cb76df251] Instance allocations successfully created on destination node fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa: {'allocations': {'fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89924) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:56:54.093066 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'resources' on Instance uuid 84550127-960e-4f04-a54f-d79cb76df251 {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:56:54.098757 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'pci_requests' on Instance uuid 84550127-960e-4f04-a54f-d79cb76df251 {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:56:54.650922 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.live_migrate [None req-40c292ca-24ef-455e-9c55-2ff7dc2f9175 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 84550127-960e-4f04-a54f-d79cb76df251] Start binding ports on destination host: n-h1-816927-6 {{(pid=89924) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:57:03.595352 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:03.663487 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:03.664154 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:03.783070 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:03.784436 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:03.788430 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:03.789655 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:03.833623 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:03.848803 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for user d04f30704c1e4507984e8b52df6947f3 and project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:03.874736 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 796cd305-6990-42a2-aa51-37e0b9138380] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:03.879159 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:03.879159 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:03.892514 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 796cd305-6990-42a2-aa51-37e0b9138380] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:03.895875 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:03.897592 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:04.002744 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:04.003511 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-22be7a97-e79c-4ff3-9a0e-8a4875c937d4 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:06.853624 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:06.881902 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:06.882652 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:06.984058 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:06.984526 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:06.985484 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:06.986098 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:07.030158 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Getting quotas for project 182f2290bee74a79ba9509fa611d1ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:07.043265 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Getting quotas for user 4985e5b1f8ad4ac991df6a21ae7c886d and project 182f2290bee74a79ba9509fa611d1ae2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:07.059916 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] [instance: a8b2e4eb-454b-4f67-a987-952360475fbf] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:07.061186 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:07.061756 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:07.080034 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] [instance: a8b2e4eb-454b-4f67-a987-952360475fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:07.081905 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:07.082610 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:07.096212 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:07.096946 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:07.142969 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:07.144137 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c7ae0126-8f9e-46c3-9d8f-98ac19ce48c7 tempest-ServersWithSpecificFlavorTestJSON-925911539 tempest-ServersWithSpecificFlavorTestJSON-925911539-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:09.791393 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-47e0ef76-0cb2-4e6e-b29b-a2b32d450c04 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:57:09.794695 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-47e0ef76-0cb2-4e6e-b29b-a2b32d450c04 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:09.796634 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-47e0ef76-0cb2-4e6e-b29b-a2b32d450c04 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:09.847746 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-47e0ef76-0cb2-4e6e-b29b-a2b32d450c04 tempest-ServersAdminTestJSON-196565156 tempest-ServersAdminTestJSON-196565156-project] [instance: 708fb036-3bed-4b21-9fd6-3401a33aa7b9] No migration record for the rebuild/evacuate request. {{(pid=89923) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 18:57:15.802082 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:57:15.803631 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:15.804180 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:16.623591 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Created allocations for migration 8c5d4c64-de04-48c2-b915-b589986d9d4d on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:57:16.834358 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 2e47ad01-4dfa-4959-99f5-2cf26290c09f] Instance allocations successfully created on destination node 8e84d651-779a-4758-88f8-6acb550f8a09: {'allocations': {'8e84d651-779a-4758-88f8-6acb550f8a09': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89924) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:57:16.835380 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'resources' on Instance uuid 2e47ad01-4dfa-4959-99f5-2cf26290c09f {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:57:16.841986 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'pci_requests' on Instance uuid 2e47ad01-4dfa-4959-99f5-2cf26290c09f {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:57:17.725078 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.live_migrate [None req-123a3d6e-3c5d-4e11-ad0a-67aab62b980c tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 2e47ad01-4dfa-4959-99f5-2cf26290c09f] Start binding ports on destination host: n-h2-816927-6 {{(pid=89924) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:57:26.801394 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:26.859322 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:26.859768 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:26.928482 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:26.929056 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:26.930036 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:26.930436 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:26.970620 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:26.977506 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for user f6503b1e840a42abaa0ba2d79dc636d0 and project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:26.995625 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 13891317-0766-4699-a2fa-c2b79658cc1f] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:26.998778 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:26.999902 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:27.018337 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 13891317-0766-4699-a2fa-c2b79658cc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:27.021186 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:27.021824 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:27.100523 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:27.101802 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9c0784a0-639e-4199-bb95-f990d84f02b0 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:39.994820 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:57:39.998076 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:39.998698 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:40.633170 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 796cd305-6990-42a2-aa51-37e0b9138380] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89924) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:57:41.824552 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Created allocations for migration a8de58a8-d935-425b-9fc5-9fb48eef5b36 on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:57:42.525446 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-e1e25c18-9050-4b71-bc9d-f8dc7fb48068 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 796cd305-6990-42a2-aa51-37e0b9138380] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa,limits=SchedulerLimits,nodename='n-h1-816927-6',service_host='n-h1-816927-6')] {{(pid=89924) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:57:49.265990 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:57:49.312448 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.313231 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:49.401241 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.402150 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:49.403641 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.404464 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:49.445032 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:57:49.456450 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for user 0fb7f5d24dad4956ba8c305f80928690 and project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:57:49.486339 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 31b33e79-6175-4ded-806c-cf1bb909b549] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:57:49.488738 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.489756 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:49.506336 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 31b33e79-6175-4ded-806c-cf1bb909b549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:57:49.509869 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.510932 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:57:49.583442 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:57:49.584922 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3546f29f-0336-4fa6-acb2-8d0f91ab00f5 tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:02.792421 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:58:02.794229 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:02.795080 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:03.475483 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Created allocations for migration 8bc3b539-e331-4e68-9ef1-bbc4ea77e689 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:58:03.700049 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 13891317-0766-4699-a2fa-c2b79658cc1f] Instance allocations successfully created on destination node fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa: {'allocations': {'fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89924) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:58:03.700490 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'resources' on Instance uuid 13891317-0766-4699-a2fa-c2b79658cc1f {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:03.707907 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'pci_requests' on Instance uuid 13891317-0766-4699-a2fa-c2b79658cc1f {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:04.319335 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.live_migrate [None req-a8731a88-8ec2-4db0-adf1-b0626d0556ac tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 13891317-0766-4699-a2fa-c2b79658cc1f] Start binding ports on destination host: n-h1-816927-6 {{(pid=89924) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:58:18.455171 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:18.503664 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.504698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:18.607797 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.608522 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:18.610218 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.611266 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:18.646842 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:18.658180 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for user 325d0f4e494f4648b0c867b8e8fa685d and project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:18.692895 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 29123ffc-b78a-47a4-a9f5-688d0487b0b9] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:18.695524 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.700352 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:18.721140 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 29123ffc-b78a-47a4-a9f5-688d0487b0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:18.724489 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.725673 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:18.793077 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:18.793523 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6cdf8862-a3bb-46ee-86ab-22201ac9d1a2 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:20.880397 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:58:20.883051 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:20.884094 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:21.655352 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Created allocations for migration 6b436fcf-dff1-4835-8a43-16886dee3bc4 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:58:21.816655 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 31b33e79-6175-4ded-806c-cf1bb909b549] Instance allocations successfully created on destination node fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa: {'allocations': {'fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89924) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:58:21.817346 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'resources' on Instance uuid 31b33e79-6175-4ded-806c-cf1bb909b549 {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:21.831119 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'pci_requests' on Instance uuid 31b33e79-6175-4ded-806c-cf1bb909b549 {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:58:22.236645 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.live_migrate [None req-fa123fb2-4b9c-489b-b630-dc0281bf32a0 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 31b33e79-6175-4ded-806c-cf1bb909b549] Start binding ports on destination host: n-h1-816927-6 {{(pid=89924) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:58:24.499706 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:24.527586 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.528367 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:24.682554 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.684000 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:24.686514 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.687019 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:24.763668 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Getting quotas for project ef37cd7d73e046cbacdd7bfea7669b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:24.771004 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Getting quotas for user d69818c561a14c07928a1d4f9b5e8b43 and project ef37cd7d73e046cbacdd7bfea7669b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:24.786159 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] [instance: 3960a7f5-33d7-44a0-a775-2a69af51f972] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:24.787819 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.789080 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:24.832529 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] [instance: 3960a7f5-33d7-44a0-a775-2a69af51f972] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:24.844291 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.846735 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:24.978688 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:24.979041 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dbf61c26-625c-4197-9af2-17f5d9765e16 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.360053 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:32.447769 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.448418 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.649524 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.651746 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.653377 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.656426 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.679869 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Getting quotas for project aa6d7bbde6ed4e38846ab64413e46781. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:32.689064 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Getting quotas for user bcc29d8de7504d9a802a3cebb4b1e02b and project aa6d7bbde6ed4e38846ab64413e46781. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:32.710638 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] [instance: bd1b06a7-8bee-45ac-9bf6-aa1f08db5ff8] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:32.712126 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.712929 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.734124 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] [instance: bd1b06a7-8bee-45ac-9bf6-aa1f08db5ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:32.738565 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.740748 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:32.826839 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:32.827683 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f9589181-e577-4d9b-8850-e1b5643fd0c6 tempest-TenantUsagesTestJSON-1109160286 tempest-TenantUsagesTestJSON-1109160286-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:34.583980 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Took 0.88 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:34.730404 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:34.731964 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:34.881030 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:34.881642 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:34.883425 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:34.884333 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:34.944881 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:34.965900 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for user f6503b1e840a42abaa0ba2d79dc636d0 and project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:34.993349 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 5ac1edce-98ce-4993-9d79-06e19b7c2193] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:34.996712 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:34.997725 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:35.015907 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: 5ac1edce-98ce-4993-9d79-06e19b7c2193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:35.018505 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:35.020023 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:35.122659 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:35.123698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2ad4ce40-fd9a-4bd1-9778-afdc90631ad8 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.644493 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:41.686743 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.687189 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.765795 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.769893 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.771012 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.771650 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.812579 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:41.830460 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for user d04f30704c1e4507984e8b52df6947f3 and project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:41.851220 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: f83bd729-76a0-4021-a51e-be1a11d3e190] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:41.852647 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.854856 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.875902 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: f83bd729-76a0-4021-a51e-be1a11d3e190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:41.877201 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.877682 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:41.962025 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:41.962657 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d575c1a-554e-4250-86e3-90dd8f6d290c tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:51.555293 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:51.649365 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:51.650479 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:51.756883 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:51.758317 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:51.760984 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:51.763465 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:51.876124 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:51.911224 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for user 0fb7f5d24dad4956ba8c305f80928690 and project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:51.962992 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:51.965612 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:51.968351 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:51.994451 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:51.996665 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:51.997306 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.092989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.093685 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0debbfa3-2ba4-4896-a5ff-7f6f2c21ef8f tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.447685 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:52.474680 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.475355 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.559456 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.560202 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.561245 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.561817 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.583518 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Getting quotas for project 707bdebf549947e492591a7abb28dcfd. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:52.589870 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Getting quotas for user 9b38b3eedfa2499dbccd8ac3d728fb0d and project 707bdebf549947e492591a7abb28dcfd. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:52.605098 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] [instance: 9cbf5e7a-9083-4c95-9642-148220812ba7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:52.606696 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.607508 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.619933 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] [instance: 9cbf5e7a-9083-4c95-9642-148220812ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:52.624053 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.625668 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:52.702579 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:52.703677 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71cea638-949e-4891-9a10-2e7a73af61fe tempest-VolumesAdminNegativeTest-1866079745 tempest-VolumesAdminNegativeTest-1866079745-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.452580 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:58:55.529460 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.530651 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.641493 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.642524 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.644716 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.645777 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.682383 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Getting quotas for project ef37cd7d73e046cbacdd7bfea7669b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:58:55.693248 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Getting quotas for user d69818c561a14c07928a1d4f9b5e8b43 and project ef37cd7d73e046cbacdd7bfea7669b6b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:58:55.717500 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] [instance: b7962232-ecca-4199-b3be-5035c5d4174f] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:58:55.720078 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.721167 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.744127 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] [instance: b7962232-ecca-4199-b3be-5035c5d4174f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:58:55.749973 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.751061 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:58:55.827895 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:58:55.828766 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1c2d69c3-84f6-489e-a5b6-a3ab18683930 tempest-ServersAdminNegativeTestJSON-1718131127 tempest-ServersAdminNegativeTestJSON-1718131127-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:09.747447 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:59:09.748641 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:09.749213 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:10.038607 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: f83bd729-76a0-4021-a51e-be1a11d3e190] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89924) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 18:59:11.417820 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Created allocations for migration 1961d049-9d10-4aed-a5bc-b88a39958e91 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:59:11.963515 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-4343bab6-ffdd-43d0-9d77-00244bb91c88 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: f83bd729-76a0-4021-a51e-be1a11d3e190] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa,limits=SchedulerLimits,nodename='n-h1-816927-6',service_host='n-h1-816927-6')] {{(pid=89924) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 18:59:32.221724 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:59:32.222703 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:32.222703 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:32.975135 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Created allocations for migration 4a613fa2-9760-4c26-8922-9d0d64e5d969 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 18:59:33.439541 n-d-816927-6 nova-conductor[89923]: DEBUG nova.scheduler.utils [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 5ac1edce-98ce-4993-9d79-06e19b7c2193] Instance allocations successfully created on destination node fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa: {'allocations': {'fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89923) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 18:59:33.440724 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'resources' on Instance uuid 5ac1edce-98ce-4993-9d79-06e19b7c2193 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:59:33.450489 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'pci_requests' on Instance uuid 5ac1edce-98ce-4993-9d79-06e19b7c2193 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 18:59:33.956685 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.live_migrate [None req-c27eb413-7375-4836-b73f-0d7e3b2007c7 tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: 5ac1edce-98ce-4993-9d79-06e19b7c2193] Start binding ports on destination host: n-h1-816927-6 {{(pid=89923) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 18:59:38.214198 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Took 1.27 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 18:59:38.239527 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.240508 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:38.313818 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.314270 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:38.315273 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.317050 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:38.346928 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 18:59:38.355690 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for user 325d0f4e494f4648b0c867b8e8fa685d and project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 18:59:38.373023 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 0db53544-7344-481a-87e1-aefe316fbade] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 18:59:38.374434 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.375077 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:38.387616 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 0db53544-7344-481a-87e1-aefe316fbade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 18:59:38.389176 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.391335 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:38.481331 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:38.482013 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c29ed373-9155-4243-84bf-b17326a49609 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 18:59:58.958823 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 18:59:59.579891 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 18:59:59.591391 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 18:59:59.592406 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:00.596674 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Created allocations for migration 741e04f1-d47d-408e-a46f-76b553df929e on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:00:00.893888 n-d-816927-6 nova-conductor[89923]: DEBUG nova.scheduler.utils [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2] Instance allocations successfully created on destination node 8e84d651-779a-4758-88f8-6acb550f8a09: {'allocations': {'8e84d651-779a-4758-88f8-6acb550f8a09': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=89923) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 19:00:00.895107 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'resources' on Instance uuid 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:00:00.911580 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'pci_requests' on Instance uuid 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:00:01.812503 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.live_migrate [None req-7765ade4-02d3-4afa-bf80-a8b2a98c4f15 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 8ec1eef8-75b8-4ee2-8d20-88d76728b8a2] Start binding ports on destination host: n-h2-816927-6 {{(pid=89923) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:00:15.386931 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Took 1.10 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:15.531783 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:15.532196 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:15.790474 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:15.791129 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:15.797378 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:15.797714 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:15.894849 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:15.909778 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Getting quotas for user d04f30704c1e4507984e8b52df6947f3 and project 0edb5294ebd340aaadd9e684adbc9250. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:15.984368 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 00fd9201-8e8b-4f9f-8c4c-0875b111976f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:15.995093 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:15.995709 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:16.027466 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] [instance: 00fd9201-8e8b-4f9f-8c4c-0875b111976f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:16.034400 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:16.035095 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:16.177793 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:16.179255 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7bf64b62-a047-457f-a5c0-2d4cb1c3caf8 tempest-MigrationsAdminTest-838245833 tempest-MigrationsAdminTest-838245833-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.499958 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:33.597658 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.598760 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.707801 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.708506 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.709398 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.709973 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.736041 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Getting quotas for project d41bcbcb8f2c4b1a95785941644ace25. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:33.745387 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Getting quotas for user d9fb0706e1a24fd59eb51225e8f96362 and project d41bcbcb8f2c4b1a95785941644ace25. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:33.759271 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] [instance: 295dd472-091b-40cf-b179-b75bbb6ab94b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:33.760269 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.760672 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.775086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] [instance: 295dd472-091b-40cf-b179-b75bbb6ab94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:33.776396 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.777899 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:33.861002 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:33.861535 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dee4a9a8-ea56-4195-9e9d-759e6341b98b tempest-ImagesNegativeTestJSON-526186564 tempest-ImagesNegativeTestJSON-526186564-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:53.356672 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:00:53.357536 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:53.358233 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:54.146821 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:00:54.918147 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] [instance: 00fd9201-8e8b-4f9f-8c4c-0875b111976f] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89924) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:00:55.220502 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 47460. Dec 16 19:00:56.125628 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] Created allocations for migration 57563ff3-af04-49f7-a8e0-3cf24b40ac33 on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:00:56.935364 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-792b3ca9-7340-4872-baf2-caa3984c372e tempest-MigrationsAdminTest-1950444922 tempest-MigrationsAdminTest-1950444922-project-admin] [instance: 00fd9201-8e8b-4f9f-8c4c-0875b111976f] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89924) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:00:59.620424 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:00:59.657744 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:59.658512 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:59.795853 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:59.796881 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:59.800363 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:59.801185 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:59.864783 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Getting quotas for project 0f14e70946e64e37a4ec8a2299db0de9. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:00:59.877834 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Getting quotas for user 8a122d218cf348b5922fadf111b1d0cb and project 0f14e70946e64e37a4ec8a2299db0de9. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:00:59.920278 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] [instance: 6ca1025e-fe7b-4272-8dcd-8c2b9ddddfad] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:00:59.949204 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:59.949960 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:00:59.975909 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] [instance: 6ca1025e-fe7b-4272-8dcd-8c2b9ddddfad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5ea9c6e-86c4-4798-a74b-b40c7c813f92',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:00:59.982921 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:00:59.984057 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:00.057551 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:00.058305 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-395723d7-e674-4a25-8782-ecf7bc524e87 tempest-AttachSCSIVolumeTestJSON-361718452 tempest-AttachSCSIVolumeTestJSON-361718452-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:35.434862 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:35.581070 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:35.586356 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:35.785226 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:35.794500 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:35.798298 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:35.801052 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:35.880225 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:35.903125 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Getting quotas for user f6503b1e840a42abaa0ba2d79dc636d0 and project 12fa43408e2644cd9e9b5b97c1cde4ee. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:35.949393 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: acba3139-4f8e-4291-9d69-c4ecf7b973ad] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:35.955575 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:35.956807 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:35.979633 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] [instance: acba3139-4f8e-4291-9d69-c4ecf7b973ad] block_device_mapping [BlockDeviceMapping(attachment_id=ec826be1-3c15-487e-84f5-97ad56b1963e,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dee6ba28-94b8-4cff-81c4-347c5e2e8207',volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:35.982805 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:35.984605 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:36.138596 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:36.140032 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bbb0898-c3af-48c9-92d4-bba44b4d7f01 tempest-LiveAutoBlockMigrationV225Test-591630015 tempest-LiveAutoBlockMigrationV225Test-591630015-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.627790 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Took 0.86 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:39.678814 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.679801 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.781580 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.783257 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.784425 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.785240 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.828091 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:39.833955 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for user 325d0f4e494f4648b0c867b8e8fa685d and project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:39.855061 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: c1ffcef9-7978-46ee-b7ec-0b18bb3d10d3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:39.856335 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.859964 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.880452 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: c1ffcef9-7978-46ee-b7ec-0b18bb3d10d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:39.882274 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.883537 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:39.984213 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:39.984855 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-835c6661-7494-48e0-9aac-7c131dddb31f tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.311832 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:53.380960 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.382224 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.518216 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.518866 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.520281 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.520955 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.567017 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Getting quotas for project bb357e8140c3494a815fa0adfa90af78. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:53.579033 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Getting quotas for user ed5a9e5f2075460794acefd05c3aed32 and project bb357e8140c3494a815fa0adfa90af78. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:53.626204 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] [instance: cefa8374-4fd5-4daf-8251-e2c6ffcc5f8a] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:53.628015 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.629265 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.645662 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] [instance: cefa8374-4fd5-4daf-8251-e2c6ffcc5f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:53.649740 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.650506 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:53.740074 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:53.740741 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-221ce4de-f648-40dd-bd88-f8ad734ad1b8 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.544466 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:56.592934 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.594054 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.701183 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.702216 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.704208 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.705368 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.773279 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:56.787086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Getting quotas for user 0fb7f5d24dad4956ba8c305f80928690 and project 1b24670a120a4886aab97ce00c600841. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:56.822854 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 718963e9-1918-4eea-9d9e-142ccff12d9f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:56.825711 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.826925 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.850487 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] [instance: 718963e9-1918-4eea-9d9e-142ccff12d9f] block_device_mapping [BlockDeviceMapping(attachment_id=905ef696-6efb-42d3-a5f5-c7d0c5fbb5f5,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc0cbfd4-3c7f-4504-8f1e-31afbcdd2768',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:56.857488 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.859437 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:56.964241 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:56.967799 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8e8ac271-3bce-45d0-8b96-a19185620eee tempest-LiveMigrationTest-962536235 tempest-LiveMigrationTest-962536235-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.062171 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:01:58.114285 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.118408 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.193239 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.194034 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.195019 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.195648 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.219070 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Getting quotas for project bb357e8140c3494a815fa0adfa90af78. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:01:58.225376 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Getting quotas for user ed5a9e5f2075460794acefd05c3aed32 and project bb357e8140c3494a815fa0adfa90af78. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:01:58.241586 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] [instance: d74b6cb1-88c5-48fc-ac34-c458436e4a13] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:01:58.243602 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.244507 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.256788 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] [instance: d74b6cb1-88c5-48fc-ac34-c458436e4a13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:01:58.261810 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.263151 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:01:58.361495 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:01:58.362992 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-709d1b5f-01a5-4195-8802-140f6c37cfb4 tempest-ListImageFiltersTestJSON-1390925795 tempest-ListImageFiltersTestJSON-1390925795-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:13.702840 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:02:13.733045 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:13.733740 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:13.839231 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:13.840087 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:13.841761 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:13.842554 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:13.888460 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Getting quotas for project af45b1c6578b49369e638d3b6b49536b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:02:13.900326 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Getting quotas for user 83d54af5a67840c79e2a432e9232f761 and project af45b1c6578b49369e638d3b6b49536b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:02:13.922967 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] [instance: 7a803f0f-74bc-47b8-aaac-b1ac32dcdd80] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:02:13.924606 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:13.925226 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:13.955536 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] [instance: 7a803f0f-74bc-47b8-aaac-b1ac32dcdd80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:02:13.960741 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:13.960741 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:14.085348 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:14.087094 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2abcdb71-d5fa-45bf-b7f5-412ceab779b0 tempest-InstanceActionsTestJSON-1689551392 tempest-InstanceActionsTestJSON-1689551392-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:17.705859 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:02:17.706742 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:17.707111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:18.630644 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Created allocations for migration 4b5d3025-b8ac-404e-bd41-3a2b6cee577b on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:02:18.991128 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: acba3139-4f8e-4291-9d69-c4ecf7b973ad] Instance allocations successfully created on destination node fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa: {'allocations': {'fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89924) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 19:02:18.992178 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'resources' on Instance uuid acba3139-4f8e-4291-9d69-c4ecf7b973ad {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:02:18.999819 n-d-816927-6 nova-conductor[89924]: DEBUG nova.objects.instance [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] Lazy-loading 'pci_requests' on Instance uuid acba3139-4f8e-4291-9d69-c4ecf7b973ad {{(pid=89924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:02:19.600114 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.live_migrate [None req-27e7097e-1cad-4f05-adc5-12657d21578f tempest-LiveAutoBlockMigrationV225Test-561306790 tempest-LiveAutoBlockMigrationV225Test-561306790-project-admin] [instance: acba3139-4f8e-4291-9d69-c4ecf7b973ad] Start binding ports on destination host: n-h1-816927-6 {{(pid=89924) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:02:33.521321 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:02:34.572684 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 48992. Dec 16 19:02:57.581535 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:02:57.581535 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:02:57.581535 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:02:59.778983 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Created allocations for migration 90e94776-3457-47a2-b274-0f96b387a49b on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:03:00.380876 n-d-816927-6 nova-conductor[89923]: DEBUG nova.scheduler.utils [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 718963e9-1918-4eea-9d9e-142ccff12d9f] Instance allocations successfully created on destination node 8e84d651-779a-4758-88f8-6acb550f8a09: {'allocations': {'8e84d651-779a-4758-88f8-6acb550f8a09': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=89923) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:813}} Dec 16 19:03:00.380876 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'resources' on Instance uuid 718963e9-1918-4eea-9d9e-142ccff12d9f {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:03:00.411054 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] Lazy-loading 'pci_requests' on Instance uuid 718963e9-1918-4eea-9d9e-142ccff12d9f {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:03:01.278891 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.live_migrate [None req-a7287d1c-ae22-4417-a013-dd1989b373d8 tempest-LiveMigrationTest-1871653850 tempest-LiveMigrationTest-1871653850-project-admin] [instance: 718963e9-1918-4eea-9d9e-142ccff12d9f] Start binding ports on destination host: n-h2-816927-6 {{(pid=89923) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:03:15.174999 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Took 0.99 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:03:15.416961 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.417061 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.710355 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.711039 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.712344 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.713061 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.794706 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:03:15.804675 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Getting quotas for user 325d0f4e494f4648b0c867b8e8fa685d and project 0edac6d18113496abbb1b74dd2c9be33. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:03:15.850977 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 542b11f3-eb53-4a99-9317-0ff92be15e0d] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:03:15.852647 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.857864 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.882248 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] [instance: 542b11f3-eb53-4a99-9317-0ff92be15e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:03:15.884520 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.885278 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:15.969307 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:15.970594 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9d886d20-faf4-4df1-b821-635c48a9f477 tempest-ImagesTestJSON-1995919506 tempest-ImagesTestJSON-1995919506-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:19.029597 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:03:35.696897 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Took 0.74 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:03:35.783817 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:35.787678 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:35.963239 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:35.969430 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:35.970435 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:35.971183 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:36.012516 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Getting quotas for project d1fe77edaed049b6b7fbca26c0466a3d. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:03:36.031576 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Getting quotas for user 5f6b894755b442d792057051b2a33697 and project d1fe77edaed049b6b7fbca26c0466a3d. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:03:36.054946 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] [instance: 75ab1754-e082-4bad-aa57-c1070a187c5e] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:03:36.056287 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:36.058839 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:36.073699 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] [instance: 75ab1754-e082-4bad-aa57-c1070a187c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:03:36.075713 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:36.076372 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:03:36.153259 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:03:36.154160 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-be45b867-dc87-42b3-b6be-c3a9756e952d tempest-ServerDiagnosticsNegativeTest-1500778775 tempest-ServerDiagnosticsNegativeTest-1500778775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:34.830994 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Took 0.97 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:04:34.893513 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:34.893928 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:35.136111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:35.137497 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:35.139638 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:35.141340 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:35.255772 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Getting quotas for project 10125cca7ec5476ca7d908d5559805d2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:04:35.312681 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Getting quotas for user b207e6768f5d4e1a881898dfd869567a and project 10125cca7ec5476ca7d908d5559805d2. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:04:35.438945 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] [instance: 87608957-adb9-49a1-b8a7-89d84add8369] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:04:35.453254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:35.458530 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:35.489537 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] [instance: 87608957-adb9-49a1-b8a7-89d84add8369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:04:35.494394 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:35.514422 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:35.644296 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:35.645283 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e5d3d323-a763-49cf-90f2-18c2f03aa27e tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:55.241670 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:04:56.277881 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51070. Dec 16 19:04:59.477307 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 1.57 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:04:59.526872 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.527278 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:59.627997 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.631296 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:59.632429 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.632973 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:59.655893 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:04:59.661495 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:04:59.675981 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 23116541-b6ab-4239-b383-1eda88c35f9b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:04:59.677852 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.678566 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:59.698663 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 23116541-b6ab-4239-b383-1eda88c35f9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:04:59.701257 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.703852 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:04:59.789174 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:04:59.789809 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-97469714-69d5-4428-84ef-c4f48c14b6f1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:28.533195 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:28.590070 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:28.590816 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:28.701506 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:28.707961 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:28.712913 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:28.716604 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:28.848112 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Getting quotas for project a7974fc64b094047aa4b1793edb3b4df. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:28.868524 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Getting quotas for user 4ed4a3c98e064461acb9d8921676e37e and project a7974fc64b094047aa4b1793edb3b4df. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:28.916046 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] [instance: b0bf5e8c-a939-447b-96cc-7b598f442f19] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:28.917123 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:28.917421 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:28.940347 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] [instance: b0bf5e8c-a939-447b-96cc-7b598f442f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:28.941633 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:28.942028 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:29.045185 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:29.046401 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e04d8b01-ed86-4fac-bd84-fb52ba641b6e tempest-FloatingIPsAssociationNegativeTestJSON-2072297600 tempest-FloatingIPsAssociationNegativeTestJSON-2072297600-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:34.571401 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:05:35.601227 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51572. Dec 16 19:05:43.987262 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:43.990707 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:44.964615 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 0.80 seconds to select destinations for 2 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:45.082889 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.087724 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.184969 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.185784 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.295946 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.297568 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.303914 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.305342 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.368285 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:45.380213 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:45.401433 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: eacc180d-6ed6-45e7-b75f-34c480ff6ef7] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:45.402891 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.403571 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.413746 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: eacc180d-6ed6-45e7-b75f-34c480ff6ef7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:45.415527 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.416485 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.474555 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.475185 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.497113 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 8962cccb-10c9-4e10-86f5-9f7a2622c16a] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:45.498306 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance_group [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lazy-loading 'hosts' on InstanceGroup uuid 2697b090-cda1-4360-8c2a-fec07e29b9f8 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 19:05:45.563756 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.564328 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.582483 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 8962cccb-10c9-4e10-86f5-9f7a2622c16a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:45.585125 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.588252 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:45.701419 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:45.701888 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-aedb1301-9146-4e7a-a736-6a4d026a232e tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:53.857983 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Took 0.87 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:05:53.962705 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:53.968583 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:54.172636 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:54.173043 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:54.174165 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:54.174559 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:54.202791 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:05:54.211287 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for user dce4e49755384ac6a57fd62cd567a17b and project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:05:54.227520 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: cc6b45d8-e462-4575-b6bc-e84ecc4e2b7e] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:05:54.228946 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:54.229815 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:54.241491 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: cc6b45d8-e462-4575-b6bc-e84ecc4e2b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:05:54.243438 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:54.243438 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:05:54.320935 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:05:54.321348 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-804ecb7a-39f2-427f-ad40-eb15e313e8af tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:24.814279 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:24.815228 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:25.847219 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 0.97 seconds to select destinations for 2 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:25.901880 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:25.905273 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.047250 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.047654 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.147074 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.153610 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.155109 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.157119 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.187134 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:26.193664 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:26.228388 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: d99f897c-a250-4236-9326-f13acd93c636] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:26.231762 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.233735 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.249955 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: d99f897c-a250-4236-9326-f13acd93c636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:26.252579 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.253255 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.339287 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.339773 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.356692 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: df4386e5-9556-438a-acd6-5fe00c72c159] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:26.357425 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance_group [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lazy-loading 'hosts' on InstanceGroup uuid c5699087-04a8-404c-9cc8-6a4f37d20d11 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Dec 16 19:06:26.405172 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.405989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.425489 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: df4386e5-9556-438a-acd6-5fe00c72c159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:26.427682 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.429160 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:26.505097 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:26.505625 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6a70056a-fb1e-4410-89c1-fdd1c2d408b1 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.279735 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:34.319517 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.319986 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.426259 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.427536 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.429167 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.430442 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.464078 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:34.474619 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:34.497436 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 077fefb7-ec95-4850-b91b-2bfea782a78d] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:34.499552 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.500450 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.514836 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 077fefb7-ec95-4850-b91b-2bfea782a78d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:34.518155 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.519786 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:34.585277 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:34.587496 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd94a415-5008-4b7b-a5a7-b170e5e3e454 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:39.484157 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:06:52.099279 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:06:52.145428 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.145802 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.246115 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.246831 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.248196 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.249092 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.272289 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Getting quotas for project dc99d1d0739249e891af5effdc772070. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:06:52.278570 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Getting quotas for user 3a8963626b084778af45f6160c086531 and project dc99d1d0739249e891af5effdc772070. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:06:52.294567 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] [instance: de5cee0c-ee7c-4733-9019-454d6a1e5fb1] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:06:52.296890 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.297722 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.327343 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] [instance: de5cee0c-ee7c-4733-9019-454d6a1e5fb1] block_device_mapping [BlockDeviceMapping(attachment_id=76b6e477-54a8-46b4-b15b-36410e5412b5,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b5ad831b-23b6-48f0-ab03-31d79976f45d',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=4afc47f0-d826-4651-902d-81ffb357771e,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4342cb87-bfb7-4b8e-bf47-6df26c061346',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=97e9bf6d-58f6-49c8-b514-2d2908f8353f,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25a4ace3-1824-444c-a3a2-595c6d4a5e93',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:06:52.331038 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.332425 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.361295 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.361969 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.379040 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.379728 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:06:52.470669 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:06:52.471898 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5dc50c3-2654-413c-8c28-664d42e03db1 tempest-TaggedBootDevicesTest_v242-81851888 tempest-TaggedBootDevicesTest_v242-81851888-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.034011 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 0.93 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:04.122918 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.124008 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.316420 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.317484 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.319781 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.320473 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.407498 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:04.430142 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:04.450325 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 803aa9dc-9802-44de-b981-969667f54372] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:04.453012 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.454020 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.467687 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 803aa9dc-9802-44de-b981-969667f54372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:04.470677 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.472675 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:04.546247 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:04.547668 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-69946994-a8d7-42f7-b343-83aee201154a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:10.766916 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:10.919762 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:10.925737 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:11.085258 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:11.086156 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:11.087171 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:11.087814 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:11.132326 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:11.150654 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:11.172906 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: eccb5eb5-c0b5-4151-aae7-79392670dac4] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:11.174108 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:11.175146 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:11.189596 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: eccb5eb5-c0b5-4151-aae7-79392670dac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:11.192316 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:11.192727 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:11.260124 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:11.261440 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-0bf1f68e-2b03-4eb9-816c-4ec68c08b8e7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:24.724544 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Took 0.69 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:24.780569 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:24.780971 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:24.860420 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:24.860815 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:24.861811 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:24.863046 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:24.903363 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Getting quotas for project c3712cf9a6eb4741b640698637da87fe. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:24.908469 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Getting quotas for user f293bdfd8e3d4fcc89a1ea1841f26b09 and project c3712cf9a6eb4741b640698637da87fe. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:24.922199 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] [instance: ecd42896-897a-4f77-bf4a-a552a88c42b6] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:24.923499 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:24.924063 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:24.942085 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] [instance: ecd42896-897a-4f77-bf4a-a552a88c42b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:24.943670 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:24.944238 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:25.008184 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:25.009260 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-dc256216-56e1-4f11-8d3e-a0de4f80483f tempest-ImagesOneServerTestJSON-1483978068 tempest-ImagesOneServerTestJSON-1483978068-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:28.929720 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:29.061053 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.078813 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:29.231641 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.232669 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:29.236133 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.239851 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:29.285245 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:29.311059 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for user dce4e49755384ac6a57fd62cd567a17b and project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:29.344113 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: b815de71-4554-432c-b1c4-a8efaa6841e5] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:29.348960 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.356225 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:29.381983 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: b815de71-4554-432c-b1c4-a8efaa6841e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:29.384836 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.385816 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:29.489825 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:29.491634 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07851f92-f3bd-4984-b727-1c3cff712671 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:45.897769 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:45.956944 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:45.957516 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:46.054743 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:46.055783 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:46.057163 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:46.058100 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:46.088614 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Getting quotas for project 84896d3203714819b1873910070298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:46.095174 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Getting quotas for user 0c25fcaf2e15420c89367b2f4108af19 and project 84896d3203714819b1873910070298b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:46.120171 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] [instance: bd25fb11-fef4-471e-b563-c3b5a75a1c77] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:46.121859 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:46.122836 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:46.134907 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] [instance: bd25fb11-fef4-471e-b563-c3b5a75a1c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:46.136861 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:46.137755 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:46.196594 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:46.197925 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-87994257-5c67-4025-b607-77ebcb2d1999 tempest-ServerAddressesNegativeTestJSON-1881761680 tempest-ServerAddressesNegativeTestJSON-1881761680-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:49.896326 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:07:49.936919 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:49.937568 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:50.023499 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:50.024822 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:50.027275 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:50.030038 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:50.079769 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:07:50.086746 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:07:50.113503 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 3c7d8ade-61c0-406e-a561-fb87dcc7c883] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:07:50.114850 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:50.115489 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:50.131012 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 3c7d8ade-61c0-406e-a561-fb87dcc7c883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:07:50.133108 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:50.134045 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:50.230936 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:07:50.231822 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b78e4638-c986-4cff-8029-79c6f8b6c389 tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:07:56.276016 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:07:57.324320 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53726. Dec 16 19:08:14.890185 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.92 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:14.940496 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:14.941553 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:15.048238 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:15.049972 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:15.052045 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:15.053271 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:15.094700 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:15.112897 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:15.218988 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: c21e9907-45fa-4a12-8895-758a8090e379] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:15.220763 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:15.221408 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:15.248376 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: c21e9907-45fa-4a12-8895-758a8090e379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:15.259514 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:15.263544 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:15.405870 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:15.406654 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5628095d-c4eb-4ceb-a3d8-2c49a8433fb7 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:27.753919 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:27.819707 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:27.820163 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:27.934881 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:27.936445 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:27.939820 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:27.941316 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:27.996917 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:28.008045 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Getting quotas for user 49d34756edb6464e961d7c7c1376e03e and project db04998742b948359b8845c1ed8cded3. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:28.024089 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 1645e32e-22fc-425a-899f-3eebb4c65d2b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:28.025520 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:28.026122 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:28.040044 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] [instance: 1645e32e-22fc-425a-899f-3eebb4c65d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:28.044471 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:28.045224 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:28.153367 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:28.155432 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-5544b5e8-6e7d-4b52-b995-b18ec545b10a tempest-ServersOnMultiNodesTest-1840796391 tempest-ServersOnMultiNodesTest-1840796391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:33.687415 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:33.816504 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:33.821933 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:34.065416 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:34.068093 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:34.073327 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:34.074932 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:34.161690 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Getting quotas for project 120d50ba06be48eca8fd6fae96343956. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:34.180039 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Getting quotas for user 346a06c789194909ad3b8ee7ff210dac and project 120d50ba06be48eca8fd6fae96343956. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:34.237962 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] [instance: dde10230-ce11-4356-9bf2-544a9d288b67] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:34.245659 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:34.246515 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:34.276336 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] [instance: dde10230-ce11-4356-9bf2-544a9d288b67] block_device_mapping [BlockDeviceMapping(attachment_id=bb332d33-c31a-4dd8-ad7a-c77c5670c7ff,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46a91c55-92ce-4309-b421-0fd95bdd8f0b',volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:34.281093 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:34.282721 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:34.382145 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:34.383433 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5990ecfd-329d-416a-9fa6-69cfc4b791c3 tempest-ServersTestBootFromVolume-38219438 tempest-ServersTestBootFromVolume-38219438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:35.602640 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:08:36.666365 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54244. Dec 16 19:08:38.237139 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Took 0.76 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:08:38.284605 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.287236 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.421176 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.421858 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.424745 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.425363 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.484520 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:08:38.501303 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Getting quotas for user dce4e49755384ac6a57fd62cd567a17b and project da74384ee1ec400dbc6bc7716e41dbb4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:08:38.548404 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: fb0902c4-aa44-44e9-969d-cbefb953d6c1] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:08:38.549429 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.549863 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.573886 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] [instance: fb0902c4-aa44-44e9-969d-cbefb953d6c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:08:38.580503 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.585725 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:08:38.711835 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:08:38.712498 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-665440cc-5509-4fac-b998-cfc4e2270aa6 tempest-ImagesOneServerNegativeTestJSON-307120746 tempest-ImagesOneServerNegativeTestJSON-307120746-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.445202 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:09:00.473544 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.474270 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.577982 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.578714 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.579918 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.584744 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.658494 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Getting quotas for project a2b3d4d05c4c433d875c577f41a4fab5. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:09:00.670171 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Getting quotas for user 07e0ad99720f4edca461f9c61e69eda1 and project a2b3d4d05c4c433d875c577f41a4fab5. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:09:00.700378 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] [instance: 128c02aa-1793-4b54-8885-7560fc3f3273] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:09:00.702044 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.702698 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.727510 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] [instance: 128c02aa-1793-4b54-8885-7560fc3f3273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:09:00.730185 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.730724 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:00.809734 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:00.810466 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b59c2874-8e58-46b0-ab19-2caf6872531e tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.096637 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:09:05.153149 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.153937 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.235132 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.236140 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.237891 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.238822 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.276953 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:09:05.288339 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:09:05.315520 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 54500158-2a1e-4421-95c7-6219de680063] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:09:05.317265 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.317983 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.333023 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 54500158-2a1e-4421-95c7-6219de680063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:09:05.336014 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.336998 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:05.404459 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:05.407272 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d2f9c34-fd86-488a-b7bd-2822cf4b3d37 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.122957 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:09:55.193036 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.194278 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.304052 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.304052 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.304052 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.304052 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.331669 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:09:55.331669 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:09:55.380625 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: fa560391-f94d-4e25-91ef-89f0cb3bd174] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:09:55.382573 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.382573 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.406370 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: fa560391-f94d-4e25-91ef-89f0cb3bd174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:09:55.406370 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.410018 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:55.472728 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:09:55.472728 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-5597abb8-313d-4597-94a3-c50f9e4a5e51 tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:09:59.517445 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:10:04.654037 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Took 1.72 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:04.781528 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:04.781528 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:04.944009 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:04.944009 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:04.944009 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:04.944009 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:04.992119 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Getting quotas for project a2b3d4d05c4c433d875c577f41a4fab5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:10:05.015573 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Getting quotas for user 07e0ad99720f4edca461f9c61e69eda1 and project a2b3d4d05c4c433d875c577f41a4fab5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:10:05.063227 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] [instance: c781028c-5e44-4904-be03-4044eb297d00] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:10:05.063227 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:05.063227 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:05.100813 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] [instance: c781028c-5e44-4904-be03-4044eb297d00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:10:05.106703 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:05.129247 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:05.252952 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:05.252952 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9415209c-ab5c-4318-955c-38a57620e9b8 tempest-ServerRescueTestJSON-1124771662 tempest-ServerRescueTestJSON-1124771662-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.421198 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:23.515470 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.516460 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.640711 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.641360 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.643127 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.643809 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.677716 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Getting quotas for project d0fa70c364674afdb67b6c6ad920afaf. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:10:23.688646 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Getting quotas for user 8dcc59b72e374c5b9a88095f6246eda0 and project d0fa70c364674afdb67b6c6ad920afaf. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:10:23.721238 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] [instance: 75861ae6-bc69-4be9-b02e-80bfdde28f3b] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:10:23.723471 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.724481 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.745651 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] [instance: 75861ae6-bc69-4be9-b02e-80bfdde28f3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:10:23.750198 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.752436 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:23.827360 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:23.828743 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bd734744-3997-4a01-ad5d-0acf10e951af tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:36.989775 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:37.068419 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.069957 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:37.179077 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.180027 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:37.181728 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.182383 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:37.217612 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Getting quotas for project cc5eefd6f71945478cbdbd441b5be376. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:10:37.227590 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Getting quotas for user 25dd150a6f8d4a22b009896379fecbd7 and project cc5eefd6f71945478cbdbd441b5be376. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:10:37.252345 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] [instance: e5a5e92f-4bd4-4491-a906-1f9b528b9d3e] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:10:37.254825 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.255816 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:37.270537 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] [instance: e5a5e92f-4bd4-4491-a906-1f9b528b9d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:10:37.273693 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.274698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:37.351762 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:37.352823 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-cf415f90-68d7-4417-9d64-1bdac311460e tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.084282 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:45.111953 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.112713 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.174416 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.175105 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.176026 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.176686 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.197436 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Getting quotas for project d0fa70c364674afdb67b6c6ad920afaf. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:10:45.203585 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Getting quotas for user 8dcc59b72e374c5b9a88095f6246eda0 and project d0fa70c364674afdb67b6c6ad920afaf. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:10:45.222709 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] [instance: 5d9d2585-b207-461c-a5a8-b88cf7582be6] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:10:45.225274 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.226460 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.237760 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] [instance: 5d9d2585-b207-461c-a5a8-b88cf7582be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:10:45.239205 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.239647 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:45.309381 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:45.309772 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a026e637-3fca-416f-aabb-46b846ca88c8 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.444930 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:10:48.485310 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.486346 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.570247 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.570711 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.572202 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.572684 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.594617 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Getting quotas for project 183170706a984e5abe10a29bdced7a83. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:10:48.601155 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Getting quotas for user e65c35379ae24797adedf88642ebe8cf and project 183170706a984e5abe10a29bdced7a83. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:10:48.615086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] [instance: 1ee7e8f1-e3bd-4fa7-a0a6-bc9071ff4b5f] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:10:48.616097 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.616499 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.629271 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] [instance: 1ee7e8f1-e3bd-4fa7-a0a6-bc9071ff4b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:10:48.631465 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.632182 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:48.714313 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:10:48.715082 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d40a8505-01c7-4168-b199-cb5a76a756b7 tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:10:57.326545 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:10:58.352377 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56068. Dec 16 19:11:05.386210 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:05.452749 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.453154 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:05.582103 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.583425 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:05.584256 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.584636 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:05.651081 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Getting quotas for project cc5eefd6f71945478cbdbd441b5be376. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:05.661169 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Getting quotas for user 25dd150a6f8d4a22b009896379fecbd7 and project cc5eefd6f71945478cbdbd441b5be376. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:05.686928 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] [instance: 14e2ccd7-f915-4b65-8ae5-1c7f2a1380dc] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:05.689010 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.690064 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:05.707640 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] [instance: 14e2ccd7-f915-4b65-8ae5-1c7f2a1380dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:05.711782 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.712876 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:05.797649 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:05.798360 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e212f1aa-3b29-4cc3-bb24-46b57788783b tempest-FloatingIPsAssociationTestJSON-1030805009 tempest-FloatingIPsAssociationTestJSON-1030805009-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.419715 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:34.494542 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.494961 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.607812 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.608586 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.609564 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.610245 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.671954 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:34.677893 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:34.691335 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 951d0dac-d669-4b54-b87e-dd7b80b89d25] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:34.692480 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.693170 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.709485 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 951d0dac-d669-4b54-b87e-dd7b80b89d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:34.711487 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.712171 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:34.765263 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:34.766019 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-6301933c-d361-4269-8d7f-80a1b976391e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:36.658481 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:11:37.692607 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56474. Dec 16 19:11:49.474794 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:49.524899 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.525294 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:49.603828 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.604385 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:49.606267 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.606709 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:49.630787 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Getting quotas for project d7114973ebe34ba996ee2170f73e6448. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:49.637951 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Getting quotas for user 91108fa1b0c24c40ab6283602a9f8aaf and project d7114973ebe34ba996ee2170f73e6448. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:49.654556 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] [instance: f51844d1-75cb-440c-b92d-459084a7dcc7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:49.655954 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.656356 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:49.666574 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] [instance: f51844d1-75cb-440c-b92d-459084a7dcc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:49.668507 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.669653 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:49.732862 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:49.733278 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3f90aa3e-1067-4abc-a530-3c9b3b740716 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.609907 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:52.656256 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.657418 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.743385 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.745152 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.747964 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.748947 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.803707 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Getting quotas for project 183170706a984e5abe10a29bdced7a83. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:52.823108 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Getting quotas for user e65c35379ae24797adedf88642ebe8cf and project 183170706a984e5abe10a29bdced7a83. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:52.847806 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] [instance: 99e3c06a-4489-4f3f-bf8b-ebcfc3078934] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:52.849683 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.850350 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.862498 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] [instance: 99e3c06a-4489-4f3f-bf8b-ebcfc3078934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:52.864999 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.865700 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:52.920128 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:52.920573 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-78297709-40c4-4fb4-90a5-71a1e66698dc tempest-SecurityGroupsTestJSON-1452680660 tempest-SecurityGroupsTestJSON-1452680660-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.181863 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Took 0.70 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:11:57.227663 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.228113 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.317771 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.318375 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.319257 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.319811 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.382473 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Getting quotas for project d7114973ebe34ba996ee2170f73e6448. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:11:57.405111 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Getting quotas for user 91108fa1b0c24c40ab6283602a9f8aaf and project d7114973ebe34ba996ee2170f73e6448. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:11:57.430968 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] [instance: 17a18177-a7bf-4ef6-b6e0-a6575ec74d4a] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:11:57.440252 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.441201 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.473867 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] [instance: 17a18177-a7bf-4ef6-b6e0-a6575ec74d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:11:57.476519 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.477172 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:11:57.561842 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:11:57.562413 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f95154ea-77ca-4b36-be70-5a93dbd51b56 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.716200 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:12:01.742797 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.743477 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.805690 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.806475 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.808309 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.809490 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.841848 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Getting quotas for project 10125cca7ec5476ca7d908d5559805d2. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:12:01.851215 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Getting quotas for user b207e6768f5d4e1a881898dfd869567a and project 10125cca7ec5476ca7d908d5559805d2. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:12:01.872767 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] [instance: e162c3bc-fa80-4c4f-8e58-d6226e065566] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:12:01.874999 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.875741 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.887504 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] [instance: e162c3bc-fa80-4c4f-8e58-d6226e065566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:12:01.889993 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.890771 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:01.947031 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:01.949061 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3ede5852-7c7a-48e0-afa1-2172a15ce1ff tempest-AttachVolumeTestJSON-1863738883 tempest-AttachVolumeTestJSON-1863738883-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:05.728347 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-24da3771-fd3b-4dfb-bece-b04245613170 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:12:05.729146 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-24da3771-fd3b-4dfb-bece-b04245613170 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:05.729378 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-24da3771-fd3b-4dfb-bece-b04245613170 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:05.770185 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-24da3771-fd3b-4dfb-bece-b04245613170 tempest-ServerShowV247Test-108998504 tempest-ServerShowV247Test-108998504-project] [instance: 17a18177-a7bf-4ef6-b6e0-a6575ec74d4a] No migration record for the rebuild/evacuate request. {{(pid=89924) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:12:18.663054 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:12:18.707235 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.707915 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:18.865617 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.866022 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:18.866759 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.867152 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:18.888391 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Getting quotas for project 33c9f23447584bd2a545a7a8185ca4ce. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:12:18.894651 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Getting quotas for user faa279a6927d41b9adee7b0a7aae5d74 and project 33c9f23447584bd2a545a7a8185ca4ce. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:12:18.911965 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] [instance: 9be9e97c-74de-4157-8340-aff6fa42fa1f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:12:18.913392 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.913978 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:18.929831 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] [instance: 9be9e97c-74de-4157-8340-aff6fa42fa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:12:18.931592 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.932325 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:18.996409 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:18.997130 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb09234-53d9-4f33-a364-3e8048223b55 tempest-InstanceActionsV221TestJSON-1703822405 tempest-InstanceActionsV221TestJSON-1703822405-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.069564 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:12:47.139175 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.146473 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.281558 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.281917 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.283059 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.283686 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.316004 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:12:47.323596 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Getting quotas for user 4ebf19489f8a4e55aa91602f62e38636 and project 3432b8003b7348f893d8fbb828f90347. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:12:47.340993 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 7e262b04-414f-466a-96b2-2751afabddd1] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:12:47.342620 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.342620 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.361056 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] [instance: 7e262b04-414f-466a-96b2-2751afabddd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:12:47.366113 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.366563 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:12:47.433526 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:12:47.434111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3b7f0120-fd73-474e-a16a-8541a222cc3e tempest-DeleteServersTestJSON-644418110 tempest-DeleteServersTestJSON-644418110-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:02.805369 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:02.832738 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:02.833473 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:02.916888 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:02.917801 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:02.919653 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:02.920374 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:02.968790 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Getting quotas for project 9204c163fbe54553bbdd1657ba61e93b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:02.975543 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Getting quotas for user d6973194d7a54f5587f4eead019b2e3c and project 9204c163fbe54553bbdd1657ba61e93b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:02.990970 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] [instance: 559a4ac1-aab3-4823-ad87-5e5703635b63] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:02.992359 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:02.992962 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:03.004424 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] [instance: 559a4ac1-aab3-4823-ad87-5e5703635b63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:03.006554 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:03.007248 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:03.060782 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:03.061071 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fd6ef338-9106-43a2-9296-ae241b998006 tempest-InstanceActionsNegativeTestJSON-465550898 tempest-InstanceActionsNegativeTestJSON-465550898-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:19.595095 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:13:47.259061 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:47.292727 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.293135 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:47.405524 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.408570 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:47.409763 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.410592 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:47.431053 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Getting quotas for project b9dbd37947e94639897c1f620aab8b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:47.437318 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Getting quotas for user 78ed1ccba74e416c8969a397a85a5f6c and project b9dbd37947e94639897c1f620aab8b2d. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:47.459480 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] [instance: 5431089a-9042-4171-a03a-6fb7b324069b] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:47.461281 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.461841 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:47.471049 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] [instance: 5431089a-9042-4171-a03a-6fb7b324069b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:47.473080 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.473701 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:47.525472 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:47.526025 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9492cb0b-79c0-4fa3-8f0c-5e6382deba3b tempest-ServersTestManualDisk-916109624 tempest-ServersTestManualDisk-916109624-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.262988 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Took 0.79 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:56.321193 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.324340 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.407653 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.408139 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.409830 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.410382 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.470880 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Getting quotas for project 862c074b86f14aecab572b28bb5441ae. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:56.477821 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Getting quotas for user 622899161e444dd6895f129f9dd8932c and project 862c074b86f14aecab572b28bb5441ae. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:56.496529 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] [instance: aed59ec3-c80c-4497-b8e9-4c3ee0ade411] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:56.497733 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.499157 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.513193 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] [instance: aed59ec3-c80c-4497-b8e9-4c3ee0ade411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:56.514432 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.514842 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:56.609828 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:56.610578 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-bc1dc347-ee67-45b2-b9bb-db4c54cdfad6 tempest-ServerTagsTestJSON-2108602008 tempest-ServerTagsTestJSON-2108602008-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:58.352221 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:13:59.387281 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58436. Dec 16 19:13:59.612995 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Took 0.66 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:13:59.673096 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:59.675478 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:59.795042 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:59.795520 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:59.796283 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:59.796697 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:59.875913 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:13:59.881589 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for user 6a2afa19ea224c91ac9496be17f47d3b and project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:13:59.921447 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: 58932a3d-3d9c-4ee0-a9b1-a1f9b86a2d30] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:13:59.928494 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:59.928954 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:13:59.956080 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: 58932a3d-3d9c-4ee0-a9b1-a1f9b86a2d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:13:59.957527 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:13:59.957962 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:00.040666 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:00.041100 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16ab4e83-d387-4fb4-ab3f-70faf7bd0b33 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:32.859102 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:14:32.958713 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:32.963195 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:33.197691 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:33.198285 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:33.199703 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:33.200387 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:33.261617 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Getting quotas for project f2beee1cfdba484dbdb1742c4a5101e4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:14:33.294604 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Getting quotas for user cbc76c5a8c644e0888d97baee360e200 and project f2beee1cfdba484dbdb1742c4a5101e4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:14:33.325910 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] [instance: 48ebdba2-8ee1-4f10-aa5f-4be820ff15d8] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:14:33.333334 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:33.333813 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:33.353841 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] [instance: 48ebdba2-8ee1-4f10-aa5f-4be820ff15d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:14:33.355685 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:33.356661 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:33.417495 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:33.418155 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff955e36-34fd-416d-a338-cd4c038ff89b tempest-ServersTestJSON-809974992 tempest-ServersTestJSON-809974992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:37.668297 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-0cafa200-1567-4c0f-99bc-8cb75f25971e tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:14:37.669254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0cafa200-1567-4c0f-99bc-8cb75f25971e tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:37.669254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-0cafa200-1567-4c0f-99bc-8cb75f25971e tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:37.689393 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:14:37.726806 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-0cafa200-1567-4c0f-99bc-8cb75f25971e tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: 58932a3d-3d9c-4ee0-a9b1-a1f9b86a2d30] No migration record for the rebuild/evacuate request. {{(pid=89924) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:14:38.755289 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58950. Dec 16 19:14:48.236987 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-4a577651-51bb-490a-8204-34b3ca87fee2 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method unshelve_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:14:48.238543 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-4a577651-51bb-490a-8204-34b3ca87fee2 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:14:48.239171 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-4a577651-51bb-490a-8204-34b3ca87fee2 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:14:48.799337 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-4a577651-51bb-490a-8204-34b3ca87fee2 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] [instance: 75861ae6-bc69-4be9-b02e-80bfdde28f3b] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) during scheduling {{(pid=89923) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:14:49.260831 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-4a577651-51bb-490a-8204-34b3ca87fee2 tempest-ServersNegativeTestJSON-1615347101 tempest-ServersNegativeTestJSON-1615347101-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:15:28.136065 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Took 1.58 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:15:28.215395 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.216057 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:28.346436 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.347098 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:28.360416 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.361096 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:28.416858 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:15:28.428681 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for user 6a2afa19ea224c91ac9496be17f47d3b and project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:15:28.470681 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: c4bf5ba0-69dd-48b6-ba97-b35b715151a2] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:15:28.472679 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.473499 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:28.488097 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: c4bf5ba0-69dd-48b6-ba97-b35b715151a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:15:28.491886 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.493252 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:28.586882 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:28.587553 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c1087e1a-1ba7-40fa-80a3-68c6c18c5797 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:52.400888 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-8edcd926-8c36-4a16-8df0-fbb07732ca95 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:15:52.401762 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8edcd926-8c36-4a16-8df0-fbb07732ca95 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:15:52.402483 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-8edcd926-8c36-4a16-8df0-fbb07732ca95 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:15:52.454430 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-8edcd926-8c36-4a16-8df0-fbb07732ca95 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: c4bf5ba0-69dd-48b6-ba97-b35b715151a2] No migration record for the rebuild/evacuate request. {{(pid=89923) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:16:26.233485 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:16:26.270622 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.272391 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:26.364556 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.365229 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:26.367426 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.369212 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:26.414638 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:16:26.422367 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Getting quotas for user 6a2afa19ea224c91ac9496be17f47d3b and project b11e3cde3d384fceb70bc462c99bce59. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:16:26.441673 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: 11a714a3-dc25-4e6b-aba8-4e1fd656e383] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:16:26.443598 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.444180 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:26.454691 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] [instance: 11a714a3-dc25-4e6b-aba8-4e1fd656e383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:16:26.458352 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.459291 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:26.527658 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:26.528245 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fe68a173-cd6e-473f-bc68-d489efd912d2 tempest-ServerDiskConfigTestJSON-336890201 tempest-ServerDiskConfigTestJSON-336890201-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:27.769839 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:16:27.870292 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:27.871013 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:27.985295 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:27.985712 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:27.988978 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:27.989406 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:28.048274 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Getting quotas for project 8570ecb976b7448da843a2403e261b27. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:16:28.062299 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Getting quotas for user 2afe4ed4684a46359b04711603a8a660 and project 8570ecb976b7448da843a2403e261b27. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:16:28.103930 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] [instance: 1518ee81-4e1b-4877-8b9e-913459cc7440] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:16:28.106692 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:28.108826 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:28.121582 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] [instance: 1518ee81-4e1b-4877-8b9e-913459cc7440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:16:28.127109 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:28.127109 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:28.212203 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:16:28.212840 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca3e8b78-6754-4b9c-8697-684a8c189093 tempest-ServersNegativeTestMultiTenantJSON-1603030589 tempest-ServersNegativeTestMultiTenantJSON-1603030589-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:16:59.382799 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:17:00.419491 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34104. Dec 16 19:17:05.825851 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:17:29.387006 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:17:29.505348 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.508575 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.678589 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.680070 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.680843 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.681257 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.725408 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:17:29.739277 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for user fe134b64df354013a2c18a43d8314317 and project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:17:29.755835 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 56262797-8a0b-4b3a-8646-37128c26f98b] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:17:29.757167 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.758104 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.770124 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 56262797-8a0b-4b3a-8646-37128c26f98b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:17:29.772378 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.773229 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:29.838447 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:29.838943 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2792228b-54f1-4d36-b31e-c60f55b73601 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.505385 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:17:32.565727 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.566583 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.775117 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.775620 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.776424 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.776758 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.828199 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:17:32.843035 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for user fe134b64df354013a2c18a43d8314317 and project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:17:32.872679 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 58c2434e-ba78-44ef-8be1-38a61f4e1ee3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:17:32.874149 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.874787 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.889460 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 58c2434e-ba78-44ef-8be1-38a61f4e1ee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:17:32.891350 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.891777 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:32.954675 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:32.955406 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ad916107-f906-4fa6-b96b-11383ce153c0 tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.533959 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:17:34.572290 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.573236 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.669151 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.672732 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.674149 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.675955 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.719936 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:17:34.733715 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for user 0cecac207af044c2905aab312c261569 and project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:17:34.764244 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: a2cd9df2-ca6c-46aa-8a45-cb0c9257e12d] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:17:34.765506 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.766106 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.784533 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: a2cd9df2-ca6c-46aa-8a45-cb0c9257e12d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:17:34.786604 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.787195 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:34.866022 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:34.866573 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f348013e-9389-455a-875d-55e0557aad1b tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:38.729721 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:17:39.164717 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:17:39.285695 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.286359 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.403986 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.404480 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.409601 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.410086 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.457574 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:17:39.470295 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Getting quotas for user fe134b64df354013a2c18a43d8314317 and project a83b74f083a64efab878c33cbb3f6529. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:17:39.486677 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 50637dac-3613-4905-8fb0-46f55eb180ec] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:17:39.488186 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.488761 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.500174 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] [instance: 50637dac-3613-4905-8fb0-46f55eb180ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:17:39.503412 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.504341 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.585341 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:17:39.586357 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e5935ae-000a-4302-b962-1e998744a98a tempest-ListServerFiltersTestJSON-1066259554 tempest-ListServerFiltersTestJSON-1066259554-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:17:39.758147 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34862. Dec 16 19:18:19.639794 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:18:24.208444 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Took 0.62 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:18:24.303074 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.306369 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:24.424005 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.428292 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:24.429614 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.431905 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:24.479403 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:18:24.493852 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for user 0cecac207af044c2905aab312c261569 and project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:18:24.522787 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: 79bd3199-9d05-4dc7-b7d8-cf7301ef9b07] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:18:24.527185 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.527618 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:24.544936 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: 79bd3199-9d05-4dc7-b7d8-cf7301ef9b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:18:24.546710 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.547131 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:24.625633 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:24.626281 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-af90bbda-fe1a-410c-a5ac-81eb88959330 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:47.764751 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:18:47.863382 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:47.868569 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:48.085624 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:48.086029 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:48.088267 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:48.095952 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:48.134477 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:18:48.141397 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for user 7bfb9bdab8aa4b85a64fd4d712c59ea6 and project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:18:48.171942 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: bbd38a40-45d6-42c8-a731-6900afe850a9] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:18:48.175917 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:48.176692 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:48.196615 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: bbd38a40-45d6-42c8-a731-6900afe850a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:18:48.198046 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:48.198462 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:18:48.257764 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:18:48.258531 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3c78f59a-a906-4c3d-a953-7cf81646a5dc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:06.912856 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Took 0.58 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:19:06.964694 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:06.966175 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:07.169580 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:07.170995 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:07.174003 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:07.174775 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:07.211355 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:19:07.223889 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for user 0cecac207af044c2905aab312c261569 and project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:19:07.269197 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: e41594be-5e2c-4fb1-8196-e720d76ea6b3] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:19:07.274743 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:07.280615 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:07.301508 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: e41594be-5e2c-4fb1-8196-e720d76ea6b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:19:07.302790 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:07.303198 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:07.386019 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:07.386420 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-3428b9fa-bfed-4c49-a815-7477fa860d9d tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:36.865367 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:19:36.893549 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:36.894384 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:37.066429 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:37.067137 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:37.068567 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:37.069238 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:37.134839 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Getting quotas for project 30b68150f9d143a19e96f38cc306d4cb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:19:37.147108 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Getting quotas for user e9cce708692d40d3947303b063b6f519 and project 30b68150f9d143a19e96f38cc306d4cb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:19:37.170152 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] [instance: 472faeac-c98f-4b92-a227-d4604893a15e] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:19:37.172189 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:37.173267 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:37.185885 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] [instance: 472faeac-c98f-4b92-a227-d4604893a15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:19:37.188301 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:37.189130 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:19:37.256765 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:19:37.257989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3e69e497-3a8f-40f1-b0f8-3f5cb5031f79 tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:00.417531 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:20:01.454955 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 36380. Dec 16 19:20:11.250551 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:20:11.288254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.289627 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:11.341057 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.341918 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:11.342902 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.343689 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:11.365550 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:20:11.371549 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Getting quotas for user 0cecac207af044c2905aab312c261569 and project 778d1f8ebf0840c18a76773204a9c910. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:20:11.387546 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: c8d6858c-2763-4305-bcb0-71cd33844022] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:20:11.388722 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.389325 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:11.400248 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] [instance: c8d6858c-2763-4305-bcb0-71cd33844022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:20:11.403833 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.405677 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:11.465737 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:11.466153 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-941bd41e-d74f-4f22-b1bb-25f7747d59e9 tempest-AttachVolumeNegativeTest-1461276880 tempest-AttachVolumeNegativeTest-1461276880-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:14.688975 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Took 1.01 seconds to select destinations for 3 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:20:14.780068 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:14.780644 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:14.883166 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:14.883898 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.013351 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.013768 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.121929 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.122685 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.123517 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.123907 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.148391 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Getting quotas for project 5e9435fa2233437e97a4869cdf6e09d5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:20:15.154918 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Getting quotas for user e0dce92695344a0e8a4f1804fa725759 and project 5e9435fa2233437e97a4869cdf6e09d5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:20:15.170182 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: 4ad0b55e-7ee1-490e-9693-9aba749c0973] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:20:15.171281 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.171712 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.183666 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: 4ad0b55e-7ee1-490e-9693-9aba749c0973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:20:15.185469 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.185876 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.262370 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.262783 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.282428 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: cbaf25be-c045-41c9-bdcd-72281fd860be] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:20:15.285724 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.286117 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.309501 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: cbaf25be-c045-41c9-bdcd-72281fd860be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:20:15.314083 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.317434 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.389698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.390922 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.408054 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: a875c4c4-5853-455f-aff0-4548b0c4a130] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:20:15.409013 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.409621 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.442431 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] [instance: a875c4c4-5853-455f-aff0-4548b0c4a130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:20:15.449974 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.451915 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:15.528974 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:15.529554 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-07430aa6-b5d2-4f29-9e15-ec55f8eb2de9 tempest-ListServersNegativeTestJSON-1209840167 tempest-ListServersNegativeTestJSON-1209840167-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:21.487284 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:21.488457 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.101754 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:20:22.127057 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.127751 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.231173 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.232028 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.237365 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.237931 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.281345 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Getting quotas for project 31d5372e9a0b4bafb464eba23ce8b1a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:20:22.292334 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Getting quotas for user 24fc0c913fd74793afaf7b252a2b4cff and project 31d5372e9a0b4bafb464eba23ce8b1a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:20:22.318777 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] [instance: 0ee1d080-75a6-44bd-b762-9509d423c77b] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:20:22.321093 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.322942 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.338874 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] [instance: 0ee1d080-75a6-44bd-b762-9509d423c77b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:20:22.341102 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.341515 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:22.407338 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:20:22.408002 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-b41f2d42-3815-4c03-9bf8-b3d292f0c0d4 tempest-ServerGroupTestJSON-1400243992 tempest-ServerGroupTestJSON-1400243992-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:20:25.856484 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:20:39.756883 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:20:40.781081 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 36874. Dec 16 19:21:39.663716 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:21:40.140083 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Took 1.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:21:40.190263 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.190977 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:40.418571 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.419015 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:40.424445 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.424883 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:40.480362 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Getting quotas for project 4c272929a0d242f5ac2f1300f53297d0. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:21:40.498013 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Getting quotas for user 19a1fd16b3fb493d9704f51ad06d983b and project 4c272929a0d242f5ac2f1300f53297d0. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:21:40.529717 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] [instance: b837b4c4-4dd4-46d4-b0eb-d6fc47ba6828] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:21:40.532638 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.533607 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:40.566702 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] [instance: b837b4c4-4dd4-46d4-b0eb-d6fc47ba6828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:21:40.570328 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.572257 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:40.685944 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:40.691790 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-95c40609-105d-43be-b16e-11f66f6dc1f1 tempest-ServerMetadataNegativeTestJSON-1061287434 tempest-ServerMetadataNegativeTestJSON-1061287434-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.400065 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Took 0.87 seconds to select destinations for 2 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:21:57.456110 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:57.457071 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.628222 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:57.629144 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.809482 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:57.813653 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.817785 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:57.821747 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.900812 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Getting quotas for project a4e31dbb276045b0bfdd738ed0e06537. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:21:57.918265 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Getting quotas for user 1ddaa1644fa14e908523d96e71a0cb86 and project a4e31dbb276045b0bfdd738ed0e06537. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:21:57.964108 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: 52204bd4-7f65-4fb9-bf20-53919e37a2d0] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:21:57.966833 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:57.971096 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:57.999007 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: 52204bd4-7f65-4fb9-bf20-53919e37a2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:21:58.003104 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:58.005782 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:58.105092 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:58.105811 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:58.157197 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: 709dfa3d-56dd-475f-9df6-77da5d8cc5ec] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:21:58.162363 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:58.163797 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:58.214844 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: 709dfa3d-56dd-475f-9df6-77da5d8cc5ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:21:58.226032 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:58.230254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:21:58.337705 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:21:58.338509 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4ef1bd95-4642-4385-8237-6337b8601177 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:03.929006 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:22:04.018713 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.021573 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:04.170075 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.171496 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:04.173264 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.177046 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:04.263873 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Getting quotas for project 30b68150f9d143a19e96f38cc306d4cb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:22:04.274419 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Getting quotas for user e9cce708692d40d3947303b063b6f519 and project 30b68150f9d143a19e96f38cc306d4cb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:22:04.295441 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] [instance: e2f55757-346b-4c71-935b-68312eecd0e9] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:22:04.297548 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.298561 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:04.312733 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] [instance: e2f55757-346b-4c71-935b-68312eecd0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:22:04.316176 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.321182 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:04.390762 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:04.392931 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f2650542-9e9a-41d5-ba34-3c9decc1dd4b tempest-ServersTestMultiNic-808286267 tempest-ServersTestMultiNic-808286267-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.292779 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Took 0.91 seconds to select destinations for 2 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:22:55.374365 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.377283 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.571081 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.571688 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.671028 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.671839 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.673197 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.673833 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.703907 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Getting quotas for project a4e31dbb276045b0bfdd738ed0e06537. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:22:55.713734 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Getting quotas for user 1ddaa1644fa14e908523d96e71a0cb86 and project a4e31dbb276045b0bfdd738ed0e06537. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:22:55.729810 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: da1b547d-3f54-4f8e-b74b-0acdd8c1841d] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:22:55.732013 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.732928 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.745225 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: da1b547d-3f54-4f8e-b74b-0acdd8c1841d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:22:55.748312 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.749253 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.824844 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.825940 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.863953 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: fb387e06-06d7-4e33-bb8f-7696598cd512] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:22:55.870147 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.871733 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:55.904944 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] [instance: fb387e06-06d7-4e33-bb8f-7696598cd512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:22:55.906683 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:55.907357 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:22:56.001188 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:22:56.002176 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a91bd22c-89bb-4a19-a9c7-291cb5ab9303 tempest-MultipleCreateTestJSON-989725863 tempest-MultipleCreateTestJSON-989725863-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:01.458314 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:23:02.493853 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 38872. Dec 16 19:23:37.347161 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:23:37.387912 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.388589 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:37.500825 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.501377 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:37.502153 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.502857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:37.542794 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Getting quotas for project a820d78ea79d4ce28b303d65531306e5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:23:37.553610 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Getting quotas for user 2420702581bd49e9a31e470542cfb8cd and project a820d78ea79d4ce28b303d65531306e5. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:23:37.579868 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] [instance: b4f3566b-550b-42b9-b7ec-369d19de2227] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:23:37.581259 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.582021 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:37.597167 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] [instance: b4f3566b-550b-42b9-b7ec-369d19de2227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:23:37.598633 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.599574 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:37.679975 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:37.680924 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-1f3fbcd7-dd94-49ba-b1a3-fb527588499a tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:40.781774 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:23:41.820001 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39498. Dec 16 19:23:43.814518 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:23:43.889016 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:43.890203 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:44.089042 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:44.089730 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:44.093341 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:44.093916 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:44.163865 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Getting quotas for project a820d78ea79d4ce28b303d65531306e5. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:23:44.179158 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Getting quotas for user 2420702581bd49e9a31e470542cfb8cd and project a820d78ea79d4ce28b303d65531306e5. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:23:44.238227 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] [instance: 555ea18f-c8ef-4234-9c07-b320e4ee9904] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:23:44.243237 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:44.246426 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:44.289415 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] [instance: 555ea18f-c8ef-4234-9c07-b320e4ee9904] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:23:44.303091 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:44.303723 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:44.402939 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:44.404164 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-e488ac00-45b2-40e2-bb22-6569752efaf5 tempest-ServerRescueNegativeTestJSON-1706054328 tempest-ServerRescueNegativeTestJSON-1706054328-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:45.909038 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:23:52.726336 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:23:52.817649 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:52.818740 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:52.882935 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:52.884291 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:52.885558 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:52.886338 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:52.911247 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:23:52.917899 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for user 7bfb9bdab8aa4b85a64fd4d712c59ea6 and project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:23:52.964495 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 57368656-58dd-4055-bf5c-5652d03def35] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:23:52.968716 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:52.970269 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:52.996306 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 57368656-58dd-4055-bf5c-5652d03def35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:23:52.999811 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:53.000189 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:23:53.086011 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:23:53.086709 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-523cd87d-1b82-4721-86fd-03c287ce962d tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:24:59.696705 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:25:09.399042 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Took 0.98 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:25:09.495760 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.503980 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:09.638371 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.642353 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:09.643540 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.644270 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:09.694729 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:25:09.703083 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for user 7bfb9bdab8aa4b85a64fd4d712c59ea6 and project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:25:09.741004 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 023692b3-05bd-4516-8452-5001ecfbf9f3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:25:09.742333 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.742944 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:09.760946 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 023692b3-05bd-4516-8452-5001ecfbf9f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:25:09.762690 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.764123 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:25:09.825667 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:25:09.827149 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f4e49002-54a9-4900-863d-5e77a93cab5e tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:26:02.489410 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:26:03.533119 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 42728. Dec 16 19:26:24.599211 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:26:25.642065 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43282. Dec 16 19:26:41.812765 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:26:42.902162 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43722. Dec 16 19:26:47.630423 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:26:48.686587 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43878. Dec 16 19:27:05.969757 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:27:24.523806 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:27:25.579891 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 44902. Dec 16 19:27:31.395494 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:27:32.480830 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 45014. Dec 16 19:27:51.525055 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:27:52.190117 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Took 1.49 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:27:52.263095 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.264272 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:52.382739 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.383814 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:52.386712 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.387724 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:52.454984 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:27:52.487590 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for user 7bfb9bdab8aa4b85a64fd4d712c59ea6 and project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:27:52.518093 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: c8154f37-c549-4afc-9944-ee266ceb448a] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:27:52.532956 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.534053 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:52.553662 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: c8154f37-c549-4afc-9944-ee266ceb448a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:27:52.559164 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.560624 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:52.673268 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:27:52.673268 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a07bc37f-92f7-47b4-91c5-b8b795d06dbc tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:27:54.724789 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:28:02.272141 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 2.64 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:02.297903 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.298892 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:02.365024 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.365800 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:02.367411 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.368291 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:02.392447 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:02.398445 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:02.413563 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 539a3c0d-b491-44a5-99ba-bfe0acc0565b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:02.414902 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.415577 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:02.424758 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 539a3c0d-b491-44a5-99ba-bfe0acc0565b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:02.426794 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.427536 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:02.473923 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:02.474447 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-32527311-d84e-4857-a09f-7c4628196911 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.554450 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:05.612312 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.613160 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.743128 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.744102 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.745053 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.745735 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.766013 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Getting quotas for project d346be2a0ef64fae9a75d75f429810a4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:05.771611 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Getting quotas for user 5cc48e8edf754eba9c9a6869083de730 and project d346be2a0ef64fae9a75d75f429810a4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:05.784828 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] [instance: d0d7e199-4926-498a-a890-2af22cecb7e7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:05.785938 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.786452 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.795264 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] [instance: d0d7e199-4926-498a-a890-2af22cecb7e7] block_device_mapping [BlockDeviceMapping(attachment_id=caf8e6fd-be42-40c1-bb4b-108fd304368f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='99dc4dfd-5198-4ab7-acae-7e63b022a6ac',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=811c3fed-ac58-4c37-b946-0869b658d71b,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b7dc08b0-53eb-40b1-b6b7-b7aa9d4c4a2f',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=5a1ba4e8-47ea-4995-816e-ab6dfe3e57b3,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69a8b28e-04ae-417d-9102-00c4185c10d3',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:05.797741 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.798360 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.808791 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.809698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.820960 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.821931 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:05.861837 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:05.863179 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff7fe7a1-1a00-4a1a-acd0-9a18e53bae68 tempest-TaggedBootDevicesTest-312955374 tempest-TaggedBootDevicesTest-312955374-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:19.731218 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:28:46.690506 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:46.779224 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.781463 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:46.834554 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.65 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:46.885315 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:46.885836 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.008203 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.009115 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.023873 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.024675 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.037494 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.037895 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.049203 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.049988 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.124163 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:47.146449 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:47.151699 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:47.164881 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Getting quotas for user 7bfb9bdab8aa4b85a64fd4d712c59ea6 and project a64fcce5a4944b72abe26e364a30c57e. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:47.175820 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: e745d5e0-2ce6-4669-a2f7-926eb43e103f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:47.182677 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.183132 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.210425 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: e745d5e0-2ce6-4669-a2f7-926eb43e103f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:47.211873 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.212260 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.218575 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 92f2e9dc-208d-46af-9a48-b99a6dee6b86] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:47.222187 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.244391 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.280087 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] [instance: 92f2e9dc-208d-46af-9a48-b99a6dee6b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:47.280322 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.280746 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.285157 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.287215 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.449997 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.450539 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fdd21785-ed61-461e-b96a-3abd1b352cbb tempest-ServerActionsTestJSON-114743614 tempest-ServerActionsTestJSON-114743614-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:47.544146 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:47.544747 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-e5b468c9-aecb-42b9-8904-bc026117a9fd tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.106448 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.78 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:28:53.164973 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.165375 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.290396 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.291054 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.294409 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.296422 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.369389 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:28:53.376132 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:28:53.393515 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: f6df6747-f9c5-4e8f-9333-4bc8befc710b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:28:53.396355 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.398472 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.420378 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: f6df6747-f9c5-4e8f-9333-4bc8befc710b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:28:53.424111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.424913 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:28:53.492964 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:28:53.494583 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d542edae-a37e-4c19-acb1-1951a3068c80 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:03.535178 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:29:04.565619 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 47090. Dec 16 19:29:27.573854 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:29:27.701962 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:27.704296 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:27.877780 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:27.880344 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:27.889842 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:27.892580 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:27.963067 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Getting quotas for project b86bf198555c4fa0ac62f2e248865bbc. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:29:27.981245 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Getting quotas for user 281c887effda43c1968673ce773c5631 and project b86bf198555c4fa0ac62f2e248865bbc. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:29:28.033043 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] [instance: f0f13e48-9120-4251-ab56-2cdbc75a05c0] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:29:28.034410 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:28.036591 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:28.050060 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] [instance: f0f13e48-9120-4251-ab56-2cdbc75a05c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:29:28.060870 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:28.061872 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:28.164363 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:28.165375 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ff1f2218-2801-425d-a787-15564e2946ff tempest-VolumesBackupsTest-1922974438 tempest-VolumesBackupsTest-1922974438-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:42.882141 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:29:43.904147 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 47662. Dec 16 19:29:45.318743 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:29:45.377493 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.379511 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:45.466235 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.466935 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:45.467932 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.468722 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:45.491158 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:29:45.498962 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:29:45.515135 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 20a49110-4bb6-4c39-a389-0ad6bcc1a802] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:29:45.516389 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.516978 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:45.532084 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 20a49110-4bb6-4c39-a389-0ad6bcc1a802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:29:45.534681 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.535429 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:29:45.637774 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:29:45.638883 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-a00ea1fd-27cd-44fe-b618-6cbafcb68210 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:26.012059 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:30:29.787928 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.64 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:30:29.817720 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:29.818134 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:29.901829 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:29.902493 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:29.903432 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:29.903987 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:30.041036 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:30:30.113107 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:30:30.169859 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: b64805a8-e151-4d57-860f-2479cf21efb0] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:30:30.181197 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:30.182164 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:30.200448 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: b64805a8-e151-4d57-860f-2479cf21efb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:30:30.203182 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:30.204673 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:30:30.319967 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:30:30.320640 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-919d4cd4-c556-4b2e-8d21-70f74b4ec320 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.459557 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:31:12.517566 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.518039 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.627279 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.627686 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.628414 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.628949 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.672837 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:31:12.689145 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:31:12.769552 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 08902592-0028-49c1-b7c2-d84d26e5de49] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:31:12.776569 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.778030 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.803555 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 08902592-0028-49c1-b7c2-d84d26e5de49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:31:12.808521 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.809654 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:12.880871 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:31:12.881639 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-71837f64-7040-4039-8b0b-6942f3486c94 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:31:39.780514 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:32:04.565264 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:32:05.589036 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50994. Dec 16 19:32:16.794298 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:32:16.876698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:16.877443 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:17.027391 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:17.028587 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:17.029465 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:17.030015 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:17.053548 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:32:17.061143 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:32:17.127270 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 38acce24-3845-42e0-bddb-14dcf55c7541] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:32:17.128550 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:17.129091 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:17.146931 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 38acce24-3845-42e0-bddb-14dcf55c7541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:32:17.148651 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:17.149202 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:17.205933 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:32:17.206699 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fed9a89f-e8e2-41fd-a578-5bbd70bfb5f4 tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:32:43.914265 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:32:44.948656 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51844. Dec 16 19:33:03.109583 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Took 1.27 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:33:03.197364 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.201211 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:03.378841 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.381027 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:03.390313 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.391234 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:03.499586 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Getting quotas for project 827509e286ea4dfbb7ff17452dcf7e56. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:33:03.520977 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Getting quotas for user aeeda4c5ec3f47099207a8c0bb76080e and project 827509e286ea4dfbb7ff17452dcf7e56. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:33:03.572125 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] [instance: 805f2d24-0a86-42af-b3ef-503ee639d0bd] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:33:03.574624 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.575692 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:03.590175 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] [instance: 805f2d24-0a86-42af-b3ef-503ee639d0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:33:03.592965 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.595833 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:03.698760 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:03.699402 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-6afe5874-d1be-4b66-b1bb-fb6f9399fc51 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.027924 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:33:06.087821 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.088225 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.203466 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.204542 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.205288 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.205679 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.249239 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:33:06.270509 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Getting quotas for user c0e1bba7c3be41c3824e6316a0bbb450 and project 413a5b5766e2453b9fb14f858fb8f998. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:33:06.295607 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 7fdce048-974c-4b95-ad00-d65490725a44] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:33:06.296577 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.297145 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.316161 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] [instance: 7fdce048-974c-4b95-ad00-d65490725a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:33:06.321135 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.322185 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:06.425709 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:06.425709 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9127b466-c893-4c07-8316-6c4cbf187a8c tempest-ServersTestJSON-1234307446 tempest-ServersTestJSON-1234307446-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.258822 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:33:15.301426 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.302161 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.454165 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.457065 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.460551 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.462598 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.522164 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Getting quotas for project acba2b3e76b54dbfbe3487ce3a115921. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:33:15.569714 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Getting quotas for user 5d653771577a471aaf2484e9d832a198 and project acba2b3e76b54dbfbe3487ce3a115921. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:33:15.615819 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] [instance: 01e30f0b-d10a-489d-8d62-2c2ad7cf14e9] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:33:15.616831 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.617239 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.646423 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] [instance: 01e30f0b-d10a-489d-8d62-2c2ad7cf14e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:33:15.647735 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.648141 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:15.714600 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:33:15.715013 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-441e8359-8d1d-4b7f-a5dd-c4bc3171c7a6 tempest-ServerRescueTestJSONUnderV235-844470272 tempest-ServerRescueTestJSONUnderV235-844470272-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:33:46.056479 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:34:39.186133 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:34:39.269441 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.273046 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:39.437066 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.437620 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:39.438903 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.439642 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:39.493903 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Getting quotas for project ed77f1c856044ed680fc2db6632aa50f. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:34:39.501075 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Getting quotas for user 78ea7dca982e42b786c2c21d9317f621 and project ed77f1c856044ed680fc2db6632aa50f. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:34:39.518270 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] [instance: 9399fb8d-7f13-4cd0-9e80-891823953aa5] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:34:39.519587 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.520328 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:39.530147 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] [instance: 9399fb8d-7f13-4cd0-9e80-891823953aa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:34:39.532019 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.532992 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:39.594458 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:39.595164 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b7782182-2cf7-4e1e-a7d6-74be8de44dc3 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:50.988899 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-def9289c-14ee-4c66-9f89-e9e39e4467c8 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:34:50.989864 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-def9289c-14ee-4c66-9f89-e9e39e4467c8 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:34:50.990210 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-def9289c-14ee-4c66-9f89-e9e39e4467c8 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:34:51.043770 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-def9289c-14ee-4c66-9f89-e9e39e4467c8 tempest-ServerShowV254Test-1257898775 tempest-ServerShowV254Test-1257898775-project] [instance: 9399fb8d-7f13-4cd0-9e80-891823953aa5] No migration record for the rebuild/evacuate request. {{(pid=89924) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:34:59.816244 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:35:05.604877 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:35:06.666969 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55070. Dec 16 19:35:15.646868 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Took 1.05 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:35:15.759857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:15.759857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:15.892679 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:15.892679 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:15.892679 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:15.892679 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:15.930305 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Getting quotas for project 827509e286ea4dfbb7ff17452dcf7e56. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:35:15.961191 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Getting quotas for user aeeda4c5ec3f47099207a8c0bb76080e and project 827509e286ea4dfbb7ff17452dcf7e56. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:35:16.030866 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] [instance: 006a39b3-bad7-418f-b59d-5ca25ad2061d] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:35:16.031268 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:16.031713 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:16.054285 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] [instance: 006a39b3-bad7-418f-b59d-5ca25ad2061d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:35:16.073713 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:16.074231 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:16.166789 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:35:16.167451 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-218caa10-a635-4f26-a323-d4961eebdc19 tempest-VolumesSnapshotTestJSON-394763036 tempest-VolumesSnapshotTestJSON-394763036-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:35:32.488070 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:35:33.532684 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55512. Dec 16 19:35:44.947769 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:35:46.057415 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55738. Dec 16 19:36:11.624268 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:37:25.579733 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:37:25.641238 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:37:26.616738 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58410. Dec 16 19:37:26.708306 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58412. Dec 16 19:37:48.698845 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:37:49.754944 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58952. Dec 16 19:37:54.799642 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:38:06.659203 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:38:07.700713 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59412. Dec 16 19:38:07.740059 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:38:09.355376 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:38:19.911888 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:38:33.523171 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:38:34.555803 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 60122. Dec 16 19:38:46.018305 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:38:47.073331 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 60434. Dec 16 19:39:31.691173 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:40:07.812629 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Took 1.17 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:40:07.863660 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:07.864064 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:07.963172 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:07.963723 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:07.964361 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:07.964654 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:07.994033 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:40:07.999296 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for user 083a836fab754153a0af24a0ddbd59b2 and project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:40:08.014924 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: 0d1eb16c-c7ec-4426-8ac1-503aaf8cbbce] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:40:08.016144 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:08.016930 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:08.032256 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: 0d1eb16c-c7ec-4426-8ac1-503aaf8cbbce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:40:08.038086 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:08.040448 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:08.144313 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:08.144716 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2ed70465-e1e7-4040-8453-ec46d5328afc tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:26.102378 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:40:26.691676 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:40:27.732492 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34520. Dec 16 19:40:44.747682 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:40:44.787050 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:44.787378 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:44.882662 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:44.883297 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:44.884329 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:44.884855 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:44.907025 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Getting quotas for project 689436da7c19464dbd4b5615b213ea28. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:40:44.916933 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Getting quotas for user 6745c83d298542c8a79b87861586eefc and project 689436da7c19464dbd4b5615b213ea28. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:40:44.930925 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] [instance: 546de1bb-4299-4c0c-a0dc-9bfcadd9b1c7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:40:44.932493 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:44.933160 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:44.948848 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] [instance: 546de1bb-4299-4c0c-a0dc-9bfcadd9b1c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:40:44.955055 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:44.955978 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:45.028129 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:45.028540 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2c9e232d-f69f-4510-9edd-9ab6da95b7b4 tempest-VolumesActionsTest-1623002074 tempest-VolumesActionsTest-1623002074-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:49.756737 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:40:50.797927 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 34810. Dec 16 19:40:59.449974 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:40:59.496742 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.498315 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:59.612214 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.615263 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:59.617655 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.618165 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:59.664926 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Getting quotas for project 31c73dc08db7445882227bb3a0319f10. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:40:59.680702 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Getting quotas for user 622fcf698d424ee1baf36dfeb7eb95b3 and project 31c73dc08db7445882227bb3a0319f10. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:40:59.700246 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] [instance: 3c0b0920-e9d4-40a4-9fde-d5d4feaea3f7] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:40:59.701482 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.707297 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:59.731557 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] [instance: 3c0b0920-e9d4-40a4-9fde-d5d4feaea3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:40:59.732902 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.733410 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:40:59.774628 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:40:59.775814 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d4af0f74-524e-48b0-9b25-7b814ac9039e tempest-ServerAddressesTestJSON-1310282375 tempest-ServerAddressesTestJSON-1310282375-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.515675 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:41:03.600523 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.610969 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.698338 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.699061 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.700235 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.701683 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.727357 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Getting quotas for project e41c8e08d35c4f439e10543dd6c4f980. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:41:03.733010 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Getting quotas for user 9c7d6f711d5142929d06c73af1ecb263 and project e41c8e08d35c4f439e10543dd6c4f980. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:41:03.751356 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] [instance: 529a97f7-4170-4665-b320-ad70fea7bdb8] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:41:03.752584 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.753142 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.763825 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] [instance: 529a97f7-4170-4665-b320-ad70fea7bdb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:41:03.765867 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.766634 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:03.809150 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:03.809922 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-59cc8e26-ccab-4e1e-a76f-0d380b7cc967 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:07.698280 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:41:08.742933 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 35178. Dec 16 19:41:22.357232 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:41:22.502994 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.517886 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:22.702222 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.705073 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:22.706063 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.707963 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:22.758057 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:41:22.767097 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for user 083a836fab754153a0af24a0ddbd59b2 and project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:41:22.814047 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: d5387e82-8249-40b5-ad9e-89d74e301b80] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:41:22.816980 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.820379 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:22.840812 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: d5387e82-8249-40b5-ad9e-89d74e301b80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:41:22.843256 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.844081 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:22.911420 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:22.913053 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-368586f6-6837-48a7-9c16-804ef34bd491 tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:35.925827 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Took 0.68 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:41:35.966263 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:35.967195 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:36.107401 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:36.107805 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:36.116354 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:36.117442 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:36.176386 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Getting quotas for project e41c8e08d35c4f439e10543dd6c4f980. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:41:36.183350 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Getting quotas for user 9c7d6f711d5142929d06c73af1ecb263 and project e41c8e08d35c4f439e10543dd6c4f980. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:41:36.242900 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] [instance: 7913b4d6-7dfa-4a85-86b8-b44486bba4fe] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:41:36.244104 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:36.244510 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:36.267166 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] [instance: 7913b4d6-7dfa-4a85-86b8-b44486bba4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:41:36.268738 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:36.269172 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:36.362918 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:36.364481 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-330fb1ff-6f1b-4fea-b9b7-b6eab9c92873 tempest-VolumesActionsTest-558710738 tempest-VolumesActionsTest-558710738-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:39.952720 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:41:45.968902 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:41:46.039407 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.040373 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:46.159007 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.160902 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:46.162026 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.163900 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:46.216225 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Getting quotas for project f8854f26b6fc425c8772ad6190fd91e8. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:41:46.229288 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Getting quotas for user 942dd446bd3a4da6b5a005356a9ed9cc and project f8854f26b6fc425c8772ad6190fd91e8. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:41:46.252112 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] [instance: 9bdadebd-4933-4fcc-acff-0821827f5fe2] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:41:46.254495 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.255141 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:46.266285 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] [instance: 9bdadebd-4933-4fcc-acff-0821827f5fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:41:46.268623 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.269425 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:46.320972 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:41:46.321768 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d5acffad-ab17-4da2-91c5-73b2f2c5c77f tempest-ServerPasswordTestJSON-1525950550 tempest-ServerPasswordTestJSON-1525950550-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:41:47.068952 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:41:48.092578 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 35772. Dec 16 19:42:19.522228 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Took 1.33 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:42:19.586991 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.587969 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.708986 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.710142 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.711758 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.712821 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.749664 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Getting quotas for project aae2d2298b0b4b28a751ce4e19953ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:42:19.758283 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Getting quotas for user 698e263a66c747d89ff29564a7f309a6 and project aae2d2298b0b4b28a751ce4e19953ff4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:42:19.775581 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] [instance: 4fba8153-d239-4de8-a9ca-1499f57da48c] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:42:19.776986 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.777896 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.791739 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] [instance: 4fba8153-d239-4de8-a9ca-1499f57da48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:42:19.793898 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.794736 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:19.847764 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:19.849311 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-fd72797f-dbab-425e-83d4-b9f3357e9ddf tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:26.269394 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2e7a0734-b2ec-485a-85dc-cf47f19c2d68 tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:42:26.270128 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e7a0734-b2ec-485a-85dc-cf47f19c2d68 tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:42:26.270520 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2e7a0734-b2ec-485a-85dc-cf47f19c2d68 tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:42:26.338085 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2e7a0734-b2ec-485a-85dc-cf47f19c2d68 tempest-ServerShowV257Test-1235101968 tempest-ServerShowV257Test-1235101968-project] [instance: 4fba8153-d239-4de8-a9ca-1499f57da48c] No migration record for the rebuild/evacuate request. {{(pid=89923) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:43:29.674199 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Took 1.29 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:43:29.731926 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:29.732582 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:29.849109 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:29.849590 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:29.852198 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:29.853255 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:29.932399 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:43:29.940413 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Getting quotas for user 083a836fab754153a0af24a0ddbd59b2 and project bf64f8ec888d461aa88b3b23774673be. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:43:29.960706 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: 7b67fc25-bf02-46f8-80b8-f98f1e2baf05] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:43:29.962899 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:29.966610 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:29.990974 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] [instance: 7b67fc25-bf02-46f8-80b8-f98f1e2baf05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:43:29.993220 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:29.993966 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:30.082611 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:30.083378 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-4bf064b1-2e14-422d-ae5e-e44803ae41cf tempest-TestNetworkBasicOps-658691243 tempest-TestNetworkBasicOps-658691243-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.176108 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:43:37.208124 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.209150 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.322960 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.324181 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.326734 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.328780 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.373569 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Getting quotas for project 513b7bb999bc4c1db0095f824df963a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:43:37.392234 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Getting quotas for user b2e076e45c514f0b8d0df70ee9874791 and project 513b7bb999bc4c1db0095f824df963a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:43:37.436649 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: ee36330f-a4de-4d20-86a5-33831f6eecb7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:43:37.445857 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.453823 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.471597 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: ee36330f-a4de-4d20-86a5-33831f6eecb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:43:37.472566 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.472967 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:37.549685 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:43:37.550084 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-98efb18e-b8ec-4985-9c07-0ecad5652ac5 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:43:46.139955 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:44:08.740228 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:44:09.769837 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 39086. Dec 16 19:44:48.092811 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:44:49.108478 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40178. Dec 16 19:44:59.986703 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:45:34.547003 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:45:35.571941 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41264. Dec 16 19:45:50.799947 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:45:51.824829 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41450. Dec 16 19:46:00.098729 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:46:01.120217 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41598. Dec 16 19:46:01.484716 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Took 1.39 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:46:01.564625 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.565129 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.647916 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.648321 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.649040 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.649428 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.673377 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:46:01.679098 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for user 25785cab6e024816bc801e959e46f83e and project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:46:01.695357 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 945b276a-43f9-4611-af73-f5e127c61cdd] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:46:01.697155 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.697830 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.709879 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 945b276a-43f9-4611-af73-f5e127c61cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:46:01.711715 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.712338 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.759719 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:01.760328 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:01.773041 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [2a6041c4-56f4-4504-9355-bec2079689c4] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 19:46:02.795226 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-059181e9-77b2-4b7d-a617-1515e230266f tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [2a6041c4-56f4-4504-9355-bec2079689c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41620. Dec 16 19:46:27.729621 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:46:27.830235 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:46:28.751610 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41810. Dec 16 19:46:29.390417 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:46:46.214515 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:46:46.215672 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:46:46.216254 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:46:46.636372 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: 945b276a-43f9-4611-af73-f5e127c61cdd] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89924) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:46:47.015084 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Created allocations for migration 0097c269-ac90-4b06-8208-0e587c37a9cd on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:46:47.284784 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-327906da-48fa-4a67-82f4-0c0bb371b2a8 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: 945b276a-43f9-4611-af73-f5e127c61cdd] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:47:06.179028 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:47:08.416990 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-72cd5a77-4a27-4208-886c-f93635a39588 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method unshelve_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:47:08.417866 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-72cd5a77-4a27-4208-886c-f93635a39588 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:08.417866 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-72cd5a77-4a27-4208-886c-f93635a39588 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:08.922639 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-72cd5a77-4a27-4208-886c-f93635a39588 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: ee36330f-a4de-4d20-86a5-33831f6eecb7] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) during scheduling {{(pid=89923) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:47:09.324314 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-72cd5a77-4a27-4208-886c-f93635a39588 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:47:09.762852 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:47:10.785468 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 42244. Dec 16 19:47:45.322688 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:47:45.361991 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.362661 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:45.421955 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.422341 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:45.423044 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.423465 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:45.444135 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Getting quotas for project 0fc89b6b58d0439493f05bcc1966efac. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:47:45.451193 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Getting quotas for user 2923a0e1fe9e408abdf78dcd2ea745f6 and project 0fc89b6b58d0439493f05bcc1966efac. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:47:45.468771 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] [instance: 03ca1d90-c126-4ca1-a537-73726214031a] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:47:45.469750 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.470154 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:45.479934 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] [instance: 03ca1d90-c126-4ca1-a537-73726214031a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:47:45.481279 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.481683 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:45.516016 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:47:45.516416 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d6b93fe-bf4d-4689-8e8b-195556959f1d tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:47:49.110188 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:47:50.132263 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 42586. Dec 16 19:48:20.010706 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:48:30.565113 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:48:30.592533 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.592939 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:30.664215 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.664856 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:30.665752 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.666259 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:30.686939 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Getting quotas for project 513b7bb999bc4c1db0095f824df963a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:48:30.694201 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Getting quotas for user b2e076e45c514f0b8d0df70ee9874791 and project 513b7bb999bc4c1db0095f824df963a1. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:48:30.711974 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: 41afb203-1b9d-49f6-a540-060e778efd09] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:48:30.713119 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.713702 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:30.722433 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: 41afb203-1b9d-49f6-a540-060e778efd09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:48:30.724386 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.724971 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:30.759747 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:30.760155 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-47cf5a9d-1952-4eeb-a4ff-beb8bc9990e2 tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.674605 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Took 1.64 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:48:31.724542 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.724948 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.814036 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.814462 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.815509 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.815914 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.837173 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:48:31.843508 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for user 25785cab6e024816bc801e959e46f83e and project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:48:31.859998 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: df8a26e9-83e4-4f84-981c-ea4c250ead11] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:48:31.861398 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.862024 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.871205 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: df8a26e9-83e4-4f84-981c-ea4c250ead11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:48:31.873112 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.873670 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:31.922318 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:31.922641 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-350a797d-b028-423b-b7c8-9618cf9c3d9b tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.090367 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:48:46.116087 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.116638 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.166328 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.166806 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.167460 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.167839 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.185373 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Getting quotas for project 0fc89b6b58d0439493f05bcc1966efac. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:48:46.190351 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Getting quotas for user 2923a0e1fe9e408abdf78dcd2ea745f6 and project 0fc89b6b58d0439493f05bcc1966efac. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:48:46.203222 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] [instance: 60e658c2-a91a-4db1-ad78-221bfd8f20e2] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:48:46.204474 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.204674 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.212623 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] [instance: 60e658c2-a91a-4db1-ad78-221bfd8f20e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:48:46.214134 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.214769 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:48:46.254594 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:48:46.255084 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-32f7bbe6-7749-4e91-96c6-39e85a203947 tempest-TestSecurityGroupsBasicOps-1794294706 tempest-TestSecurityGroupsBasicOps-1794294706-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:31.831568 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:49:31.878713 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:31.879169 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:31.946015 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:31.946312 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:31.947036 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:31.947717 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:31.965244 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Getting quotas for project bb57b2d2e78343e68e60afbf03791a19. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:49:31.970669 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Getting quotas for user f1bb4bf6ddae41ecbb1288e7a0720cb4 and project bb57b2d2e78343e68e60afbf03791a19. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:49:31.983373 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] [instance: 5f8befbf-bb4c-4a64-a3e1-57202525498c] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:49:31.984495 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:31.985070 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:31.994832 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] [instance: 5f8befbf-bb4c-4a64-a3e1-57202525498c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:49:31.996189 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:31.996586 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:49:32.034798 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:49:32.035201 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0d002c0-da6c-4896-9388-36995921e7d4 tempest-TestServerAdvancedOps-1996019643 tempest-TestServerAdvancedOps-1996019643-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:07.523935 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:50:07.525205 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:07.525880 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:07.686543 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: df8a26e9-83e4-4f84-981c-ea4c250ead11] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 19:50:08.304006 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Created allocations for migration 50f7997f-59e1-4bfa-9d06-ff7e6e8b0f63 on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:50:08.591086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c224396c-0e15-42ab-bdad-97f8a2c25868 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: df8a26e9-83e4-4f84-981c-ea4c250ead11] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 19:50:10.783237 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:50:11.806483 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43656. Dec 16 19:50:18.207937 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:50:18.230589 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.230993 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:18.288939 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.289337 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:18.290051 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.290455 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:18.309227 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Getting quotas for project f03fd5aa607245e0a9e8272382399711. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:50:18.317307 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Getting quotas for user f8f8d2b6894c440d9469a4371e65cd16 and project f03fd5aa607245e0a9e8272382399711. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:50:18.332961 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] [instance: c33ca261-e871-4850-80b1-00b48c94fe8b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:50:18.334155 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.334664 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:18.343079 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] [instance: c33ca261-e871-4850-80b1-00b48c94fe8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:50:18.345144 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.345852 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:18.392484 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:50:18.392988 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-39f1700a-9045-4203-a1a5-aa6681927ea3 tempest-TestServerBasicOps-743215027 tempest-TestServerBasicOps-743215027-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:50:26.199567 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:50:50.129961 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:50:51.145311 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43888. Dec 16 19:51:40.031972 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:52:02.839740 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-24f9fa94-87c6-4870-85d9-77dd45c18cad tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method unshelve_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:52:02.840437 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-24f9fa94-87c6-4870-85d9-77dd45c18cad tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:02.840779 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-24f9fa94-87c6-4870-85d9-77dd45c18cad tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:03.394315 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-24f9fa94-87c6-4870-85d9-77dd45c18cad tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] [instance: 41afb203-1b9d-49f6-a540-060e778efd09] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) during scheduling {{(pid=89923) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 19:52:03.877274 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-24f9fa94-87c6-4870-85d9-77dd45c18cad tempest-AttachVolumeShelveTestJSON-1795875671 tempest-AttachVolumeShelveTestJSON-1795875671-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:52:09.823633 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:52:09.903132 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:09.903677 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:10.041829 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:10.042508 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:10.043250 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:10.043694 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:10.085551 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:52:10.101878 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for user 25785cab6e024816bc801e959e46f83e and project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:52:10.121586 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 79fe5c09-8dcd-479a-9cbb-ac8a62a03290] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:52:10.122815 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:10.125411 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:10.138564 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 79fe5c09-8dcd-479a-9cbb-ac8a62a03290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:52:10.140206 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:10.141298 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:10.189534 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:10.189936 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-01573d93-894e-4057-a7a9-46b727763cb1 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:59.051016 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:52:59.051803 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:52:59.051931 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:52:59.431855 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Created allocations for migration 73df2d80-bf92-421b-ab37-74c85f486941 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 19:52:59.600340 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.live_migrate [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: 79fe5c09-8dcd-479a-9cbb-ac8a62a03290] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while live migrating {{(pid=89923) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:495}} Dec 16 19:52:59.832418 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lazy-loading 'resources' on Instance uuid 79fe5c09-8dcd-479a-9cbb-ac8a62a03290 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:52:59.836579 n-d-816927-6 nova-conductor[89923]: DEBUG nova.objects.instance [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] Lazy-loading 'pci_requests' on Instance uuid 79fe5c09-8dcd-479a-9cbb-ac8a62a03290 {{(pid=89923) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Dec 16 19:53:00.102728 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.live_migrate [None req-c950fd2d-30b3-44e4-9424-af55996b4927 tempest-TestNetworkAdvancedServerOps-282283453 tempest-TestNetworkAdvancedServerOps-282283453-project-admin] [instance: 79fe5c09-8dcd-479a-9cbb-ac8a62a03290] Start binding ports on destination host: n-h1-816927-6 {{(pid=89923) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:390}} Dec 16 19:53:11.808162 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:53:12.826132 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 44528. Dec 16 19:53:39.104732 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:53:39.130156 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.130660 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:39.177503 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.178615 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:39.178615 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.178973 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:39.194554 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:53:39.198999 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Getting quotas for user 25785cab6e024816bc801e959e46f83e and project 283cfc2a216e44de904f0ac149c3a72b. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:53:39.210386 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 25f81d2f-48f7-4a91-8b2d-51b0006092cb] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:53:39.211321 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.211729 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:39.219640 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 25f81d2f-48f7-4a91-8b2d-51b0006092cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:53:39.220889 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.221291 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:39.253451 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:53:39.254389 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-16e9788e-2403-4f94-8c47-976b3f6740b0 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:53:46.226153 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:54:22.406616 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ca5b3856-a905-49f0-a01f-9540288a6844 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method rebuild_instance {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 19:54:22.407283 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca5b3856-a905-49f0-a01f-9540288a6844 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:54:22.407632 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ca5b3856-a905-49f0-a01f-9540288a6844 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:54:22.429227 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ca5b3856-a905-49f0-a01f-9540288a6844 tempest-TestNetworkAdvancedServerOps-655673391 tempest-TestNetworkAdvancedServerOps-655673391-project] [instance: 25f81d2f-48f7-4a91-8b2d-51b0006092cb] No migration record for the rebuild/evacuate request. {{(pid=89923) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1088}} Dec 16 19:55:48.846535 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:55:48.881561 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:48.882124 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:48.955567 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:48.956514 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:48.963859 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:48.964727 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:48.995435 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Getting quotas for project 521f95031ac34632af0ee596807b458d. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:55:49.001619 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Getting quotas for user b2cb2b450c5e4f1da92922b279b3369b and project 521f95031ac34632af0ee596807b458d. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:55:49.020367 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] [instance: 85852cd4-6baa-4bf2-a498-0d6f42f90c58] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:55:49.021056 n-d-816927-6 nova-conductor[89924]: DEBUG nova.scheduler.utils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-816927-6']) and/or node ([]) {{(pid=89924) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 19:55:49.022315 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:49.022951 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:49.037138 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] [instance: 85852cd4-6baa-4bf2-a498-0d6f42f90c58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:55:49.038470 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:49.038817 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:49.085435 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:55:49.086222 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-80855712-479a-47f0-83a1-aa1e3ae4eb12 tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:55:51.150371 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:55:51.827544 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:55:52.180069 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 46472. Dec 16 19:55:52.857062 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 46488. Dec 16 19:56:01.658197 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:56:01.693754 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.694323 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:01.754622 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.755019 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:01.755838 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.756139 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:01.778169 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Getting quotas for project 8f576234c33246b6b272725eb5b4ed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:56:01.783684 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Getting quotas for user ea039def5710468d8b9e95731163f1b6 and project 8f576234c33246b6b272725eb5b4ed6c. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:56:01.796069 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] [instance: fe1f4d7f-a2d0-4d1c-9c2c-65f3f1ea95b1] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:56:01.797014 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.797410 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:01.806967 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] [instance: fe1f4d7f-a2d0-4d1c-9c2c-65f3f1ea95b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:56:01.808847 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.811547 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:01.848110 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:01.849192 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-000c2060-71cc-46c3-b1c2-2b91ded14547 tempest-VolumesNegativeTest-965156340 tempest-VolumesNegativeTest-965156340-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.667702 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:56:04.691910 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.692597 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.747884 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.748572 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.749584 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.750393 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.770021 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:56:04.775055 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:56:04.785846 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: f0feeaa1-8c87-4e29-b7fc-3503884ba531] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:56:04.786789 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.787190 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.795457 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: f0feeaa1-8c87-4e29-b7fc-3503884ba531] block_device_mapping [BlockDeviceMapping(attachment_id=e7cb2750-1a0b-4803-b195-8f3a85bc8de7,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d80f2358-ce30-487f-950a-6a53dbeedd08',volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:56:04.797155 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.797732 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:04.834552 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:04.835700 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-06c766af-5ea2-4e6e-bb9d-1f9a3a995cf5 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:07.826713 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:56:07.886067 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:07.886471 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:07.984708 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:07.985109 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:07.985822 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:07.986197 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:08.027585 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Getting quotas for project 521f95031ac34632af0ee596807b458d. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:56:08.034351 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Getting quotas for user b2cb2b450c5e4f1da92922b279b3369b and project 521f95031ac34632af0ee596807b458d. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:56:08.059086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] [instance: 4e0f993c-8277-42d0-8522-61ce01db648a] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:56:08.059086 n-d-816927-6 nova-conductor[89923]: DEBUG nova.scheduler.utils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-816927-6']) and/or node ([]) {{(pid=89923) populate_retry /opt/stack/nova/nova/scheduler/utils.py:937}} Dec 16 19:56:08.059392 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:08.059698 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:08.084654 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] [instance: 4e0f993c-8277-42d0-8522-61ce01db648a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:56:08.089447 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:08.092781 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:08.194935 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:56:08.195354 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-dd273dc2-dc91-4f78-92ed-c7cb7395a38e tempest-TestServerMultinode-1105299481 tempest-TestServerMultinode-1105299481-project-admin] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:56:12.828227 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:56:13.851150 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 46762. Dec 16 19:56:40.055460 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:57:04.654689 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:57:04.676840 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.677492 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:04.729386 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.729788 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:04.730642 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.731093 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:04.746872 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:57:04.752059 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:57:04.763015 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 6b6c9af7-d0ba-42ca-985c-19fc9a0423a3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:57:04.764359 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.764359 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:04.773508 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 6b6c9af7-d0ba-42ca-985c-19fc9a0423a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a9524ede-77d1-4534-8c95-b952349c93d9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:57:04.775251 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.775251 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:04.809724 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:57:04.810426 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-1c9b7ddf-1dfa-4825-94ff-e77fe88ff03f tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:57:06.247804 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 19:58:02.660453 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:58:02.688290 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.688290 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:02.732954 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.733350 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:02.734054 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.734434 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:02.749463 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:58:02.754404 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:58:02.764600 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 451d99b3-5e46-4380-9e22-83e97a08acec] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:58:02.765517 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.765908 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:02.773434 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 451d99b3-5e46-4380-9e22-83e97a08acec] block_device_mapping [BlockDeviceMapping(attachment_id=b425ce1d-3ad3-4fe2-82a3-4a27bb22f9ba,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7620324d-1ca7-4edb-9f1d-9221854bd045',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:58:02.774961 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.775567 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:02.805589 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:02.806027 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-593afe9f-d517-4356-a7a7-5211c1f84531 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.132305 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:58:22.160421 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.160830 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.221516 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.221916 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.222635 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.223030 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.239113 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:58:22.243714 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:58:22.260689 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 6635cbc1-b77f-4f72-a325-5c2e31734d4a] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:58:22.260689 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.260689 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.272131 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 6635cbc1-b77f-4f72-a325-5c2e31734d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2a0e5d79-d867-4921-9289-2cf21bb4edc3',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:58:22.272131 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.272131 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:22.317004 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:22.317004 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-cc76579d-469d-4184-be92-4e7489e3cc87 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:52.188865 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 19:58:53.210374 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 48800. Dec 16 19:58:56.850449 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:58:56.878989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:56.880282 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:56.941293 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:56.941293 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:56.941293 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:56.941293 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:56.974009 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Getting quotas for project 0438e626b00a4c80987250a922ba631a. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:58:56.988716 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Getting quotas for user 043e5b22957a43809d99ec840b90242d and project 0438e626b00a4c80987250a922ba631a. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:58:57.008235 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] [instance: 4183828a-2873-4f02-8346-44bde597693f] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:58:57.009061 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:57.009477 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:57.019100 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] [instance: 4183828a-2873-4f02-8346-44bde597693f] block_device_mapping [BlockDeviceMapping(attachment_id=4ed90b78-f130-422c-a2a3-bc9556af7749,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5ea1acdb-875f-488a-9396-b29909019f65',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:58:57.021590 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:57.023214 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:58:57.073023 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:58:57.073728 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9dd31336-592f-469e-9370-15d7432712fe tempest-TestVolumeBackupRestore-414983219 tempest-TestVolumeBackupRestore-414983219-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:13.849305 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 19:59:14.867671 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49024. Dec 16 19:59:26.368244 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 19:59:26.389749 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.390154 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:26.435718 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.436043 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:26.436770 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.437163 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:26.452640 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 19:59:26.457736 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 19:59:26.468076 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: ef3261fd-0575-40e8-8905-ad6e7a8c6f5b] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 19:59:26.469002 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.469404 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:26.477613 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: ef3261fd-0575-40e8-8905-ad6e7a8c6f5b] block_device_mapping [BlockDeviceMapping(attachment_id=8392cd39-a45f-44b3-bd08-97d6148d5f36,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6867ef3d-ef72-4727-8103-37a33c6b46b2',volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 19:59:26.478932 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.479407 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 19:59:26.510268 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 19:59:26.510670 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-2673333c-e9dc-44bc-8df2-241636cc6534 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:00:00.095550 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:00:26.287955 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:01:26.626453 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:27.647064 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49726. Dec 16 20:01:27.906451 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:01:28.761938 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:29.432301 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:01:29.784786 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49736. Dec 16 20:01:35.588353 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:36.604305 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49738. Dec 16 20:01:50.214252 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:01:50.237230 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.237632 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:50.281515 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.281915 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:50.282666 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.283048 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:50.299293 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:01:50.304008 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:01:50.314385 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 2e148c9a-e5b8-4fe3-b0db-4b446b4be1b9] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:01:50.315348 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.315759 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:50.323129 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: 2e148c9a-e5b8-4fe3-b0db-4b446b4be1b9] block_device_mapping [BlockDeviceMapping(attachment_id=ee6f5b33-49d8-4c28-835c-015bcd566e03,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6867ef3d-ef72-4727-8103-37a33c6b46b2',volume_size=1,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:01:50.324387 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.324785 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:50.355638 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:01:50.356141 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-bff88c6f-5bbe-4f1c-b9f7-ab033b63afad tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:01:52.859352 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:53.210841 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:01:53.875941 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49796. Dec 16 20:01:54.241989 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49798. Dec 16 20:02:14.866054 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:02:15.883250 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49838. Dec 16 20:03:20.135165 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:03:46.306205 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:03:48.526599 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:03:48.548942 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.549386 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:03:48.590601 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.590909 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:03:48.591684 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.592077 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:03:48.607496 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:03:48.612123 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Getting quotas for user bb4dac78e3a044c6a220a467e8511869 and project 2dfffe859eae44bfb96049700c076e03. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:03:48.622508 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: e601bd64-c2d0-43f4-9293-08775ab5e2a5] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:03:48.623455 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.623859 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:03:48.630606 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] [instance: e601bd64-c2d0-43f4-9293-08775ab5e2a5] block_device_mapping [BlockDeviceMapping(attachment_id=de74e67d-12a3-4fae-a246-6d614deceb13,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3dd8cbc-511e-497c-8aa7-4b5d954383dd',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:03:48.631879 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.632275 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:03:48.659015 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:03:48.659459 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f11690f7-247b-4659-a4cb-d01d997e0542 tempest-TestVolumeBootPattern-1477203561 tempest-TestVolumeBootPattern-1477203561-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:04:27.645504 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:04:28.672138 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49986. Dec 16 20:04:31.767767 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:04:34.906378 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:04:36.605182 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:04:37.621020 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 49998. Dec 16 20:04:54.241268 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:04:55.257858 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50004. Dec 16 20:05:15.883166 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:05:16.898507 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50014. Dec 16 20:05:53.877709 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:05:54.895952 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50090. Dec 16 20:06:21.697165 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:06:21.718956 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.720024 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:21.767149 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.767583 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:21.768301 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.768688 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:21.784572 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Getting quotas for project c1bd93ef3dbc482480df4b6d40276d88. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:06:21.788972 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Getting quotas for user ce1064eb8d44488c952ca32045d0abfc and project c1bd93ef3dbc482480df4b6d40276d88. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:06:21.799142 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] [instance: 3c8d749b-18e1-491a-93ce-fd625e80d5d0] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:06:21.800066 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.800468 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:21.807096 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] [instance: 3c8d749b-18e1-491a-93ce-fd625e80d5d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:06:21.808964 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.808964 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:21.835345 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:21.835748 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-f9ec9b29-2dac-41b0-8b11-d545b693740d tempest-ServersAdminNegativeTestJSON-660095790 tempest-ServersAdminNegativeTestJSON-660095790-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:40.155182 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:06:42.665675 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:06:42.689488 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.689892 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:42.751278 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.751708 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:42.752452 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.752841 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:42.769434 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Getting quotas for project dc962f28585f4e1fa02c5571044b9ece. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:06:42.773891 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Getting quotas for user e6d34169ce6c406fae1abc578af4d5d1 and project dc962f28585f4e1fa02c5571044b9ece. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:06:42.784456 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] [instance: 97b870dd-098c-478e-a2c3-21b920eacf28] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:06:42.785370 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.785766 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:42.793009 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] [instance: 97b870dd-098c-478e-a2c3-21b920eacf28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:06:42.794174 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.794614 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:42.822467 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:42.822925 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-655dd120-90c0-4750-8ca0-54d9a8f96f31 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:53.294881 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:06:53.295471 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:06:53.295788 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:06:53.545633 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] [instance: 97b870dd-098c-478e-a2c3-21b920eacf28] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:06:53.853455 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] Created allocations for migration f91084ee-3e00-470c-93e6-1b08a6f643d8 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:06:54.048622 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2cb03c30-01b7-4c95-adca-3287bee16a14 tempest-DeleteServersTestJSON-1183152415 tempest-DeleteServersTestJSON-1183152415-project] [instance: 97b870dd-098c-478e-a2c3-21b920eacf28] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"8e84d651-779a-4758-88f8-6acb550f8a09": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8e84d651-779a-4758-88f8-6acb550f8a09"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=8e84d651-779a-4758-88f8-6acb550f8a09,limits=SchedulerLimits,nodename='n-h2-816927-6',service_host='n-h2-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:07:06.327588 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:07:37.867156 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:07:37.888051 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:37.888455 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:37.940127 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:37.940523 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:37.941231 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:37.941615 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:37.957187 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Getting quotas for project 5d44ed1d23ed4a3c93ec801ef0673752. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:07:37.961784 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Getting quotas for user e3286c3f726e4225a8125949179aedba and project 5d44ed1d23ed4a3c93ec801ef0673752. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:07:37.973008 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: e352208c-92f9-4438-ab6c-15eced13d02d] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:07:37.973946 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:37.974344 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:37.980662 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: e352208c-92f9-4438-ab6c-15eced13d02d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:07:37.982416 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:37.982818 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:38.010512 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:38.010938 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-803a3141-4fc6-4c6a-b33d-515cd0b746c5 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:50.779121 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:07:50.779741 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:07:50.780057 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:07:50.955364 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: e352208c-92f9-4438-ab6c-15eced13d02d] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:07:51.303679 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Created allocations for migration c335a39c-70a7-447f-8a48-a7111c20fb4e on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:07:51.502299 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7eb330ef-6cef-406f-a173-631144befe91 tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: e352208c-92f9-4438-ab6c-15eced13d02d] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa,limits=SchedulerLimits,nodename='n-h1-816927-6',service_host='n-h1-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:07:55.260657 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:07:56.277022 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50642. Dec 16 20:08:16.900823 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:08:17.922586 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 50678. Dec 16 20:08:29.592515 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:08:29.616250 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.616656 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:29.661056 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.661427 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:29.662094 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.662481 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:29.678507 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Getting quotas for project 5d44ed1d23ed4a3c93ec801ef0673752. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:08:29.683620 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Getting quotas for user e3286c3f726e4225a8125949179aedba and project 5d44ed1d23ed4a3c93ec801ef0673752. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:08:29.696400 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: a3ee08f7-60ba-4534-a9f3-4779a5cdb26e] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:08:29.697355 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.697757 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:29.705537 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: a3ee08f7-60ba-4534-a9f3-4779a5cdb26e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:08:29.706765 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.707182 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:29.734635 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:29.735044 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d6b00959-6a3a-4a64-9532-14fe792e83ed tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:40.264612 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:08:40.265195 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:08:40.265581 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:08:40.421404 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: a3ee08f7-60ba-4534-a9f3-4779a5cdb26e] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:08:40.707634 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] Created allocations for migration a680f84f-e11a-4f6d-8923-3dbdb64ccea5 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:08:40.912935 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-d070b564-d1b7-47dc-8ffa-511149488c5e tempest-ServerDiskConfigTestJSON-1852002579 tempest-ServerDiskConfigTestJSON-1852002579-project] [instance: a3ee08f7-60ba-4534-a9f3-4779a5cdb26e] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"8e84d651-779a-4758-88f8-6acb550f8a09": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8e84d651-779a-4758-88f8-6acb550f8a09"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=8e84d651-779a-4758-88f8-6acb550f8a09,limits=SchedulerLimits,nodename='n-h2-816927-6',service_host='n-h2-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:09:34.507431 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:09:34.540878 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.541526 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:34.613258 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.613665 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:34.614386 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.614775 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:34.634852 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:09:34.639862 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for user 28b5512a1d394aceb682d14a8f2d1eba and project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:09:34.652442 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 3af5d450-1feb-4307-8498-0bea0cebba61] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:09:34.653411 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.653883 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:34.664274 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 3af5d450-1feb-4307-8498-0bea0cebba61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:09:34.665539 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.665952 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:09:34.700595 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:09:34.701003 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8d604562-0eda-4635-ac69-794691bf233f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:10:00.175522 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:10:26.351265 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:10:54.896245 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:10:55.912566 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51146. Dec 16 20:10:56.278809 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:10:57.295589 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51152. Dec 16 20:11:17.920814 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:11:18.938542 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51192. Dec 16 20:11:27.953986 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:11:29.463241 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:11:29.787441 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:11:30.809025 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51224. Dec 16 20:11:37.627980 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:11:38.645294 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51240. Dec 16 20:12:11.578501 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:12:11.579169 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:11.579402 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:11.876857 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 3af5d450-1feb-4307-8498-0bea0cebba61] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89924) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:12:12.201331 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Created allocations for migration 2b12214a-a6dc-4f03-b41b-8cfa856903d0 on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89924) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:12:12.561356 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.tasks.migrate [None req-9c9954b8-368b-454a-8995-4e122637c67a tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 3af5d450-1feb-4307-8498-0bea0cebba61] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa,limits=SchedulerLimits,nodename='n-h1-816927-6',service_host='n-h1-816927-6')] {{(pid=89924) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:12:40.736974 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:12:40.760351 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.760758 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:40.803265 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.803673 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:40.804394 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.804780 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:40.820797 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:12:40.825202 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for user 28b5512a1d394aceb682d14a8f2d1eba and project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:12:40.835357 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 33938748-e3d6-45f8-9fcc-f46dd94b18c8] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:12:40.836256 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.836653 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:40.843027 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 33938748-e3d6-45f8-9fcc-f46dd94b18c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:12:40.844224 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.844624 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:12:40.871875 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:12:40.872266 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-43511fac-bfeb-4de9-b5ba-21ca438f079f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:13:20.195937 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:13:46.378217 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:13:57.297772 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:13:58.314693 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51586. Dec 16 20:14:18.938751 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:14:19.956302 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51632. Dec 16 20:14:28.672570 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:14:29.694265 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51660. Dec 16 20:14:31.806625 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:14:34.942460 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:14:38.647235 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:14:39.664163 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 51690. Dec 16 20:14:39.992534 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:14:39.993117 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:14:39.993527 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:14:40.173685 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 33938748-e3d6-45f8-9fcc-f46dd94b18c8] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:14:40.460814 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Created allocations for migration 5fb35d8b-a809-4e9f-9bd1-928fb0ee8cdb on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:14:40.658021 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-21e57bf9-4603-4667-9529-c5560d697458 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 33938748-e3d6-45f8-9fcc-f46dd94b18c8] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"8e84d651-779a-4758-88f8-6acb550f8a09": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8e84d651-779a-4758-88f8-6acb550f8a09"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=8e84d651-779a-4758-88f8-6acb550f8a09,limits=SchedulerLimits,nodename='n-h2-816927-6',service_host='n-h2-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:15:02.373032 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:15:02.395036 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.395454 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:02.442011 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.442400 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:02.443111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.443524 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:02.458691 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:15:02.463065 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for user 28b5512a1d394aceb682d14a8f2d1eba and project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:15:02.473237 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 367aec27-7e8d-4a02-aa32-1dac6ff3a2f0] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:15:02.474157 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.474545 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:02.481763 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 367aec27-7e8d-4a02-aa32-1dac6ff3a2f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:15:02.483001 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.483436 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:15:02.511406 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:15:02.511721 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-ca404bd6-733a-4940-8149-e47709ec9dfe tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:40.217744 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:16:48.645536 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:16:48.646558 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:16:48.647044 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:16:48.919998 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 367aec27-7e8d-4a02-aa32-1dac6ff3a2f0] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:16:49.256956 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Created allocations for migration 6f7ddade-a4b1-4b65-ae33-d669a2817852 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:16:49.456186 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-7de85435-611c-4077-bef1-80e8c8d35303 tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 367aec27-7e8d-4a02-aa32-1dac6ff3a2f0] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"8e84d651-779a-4758-88f8-6acb550f8a09": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8e84d651-779a-4758-88f8-6acb550f8a09"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=8e84d651-779a-4758-88f8-6acb550f8a09,limits=SchedulerLimits,nodename='n-h2-816927-6',service_host='n-h2-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:16:58.316838 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:16:59.332337 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52050. Dec 16 20:17:06.399547 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:17:19.958302 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:17:20.975128 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52110. Dec 16 20:17:24.604764 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:17:24.626746 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.627107 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:24.669128 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.669532 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:24.670252 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.670644 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:24.686211 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:17:24.691026 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Getting quotas for user 28b5512a1d394aceb682d14a8f2d1eba and project 5d3852e3dc0846a58d2316f46f54b197. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:17:24.701727 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 6876409a-1ce1-4354-aec9-8494d4b14fc3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:17:24.702653 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.703051 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:24.709057 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 6876409a-1ce1-4354-aec9-8494d4b14fc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:17:24.710240 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.710628 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:17:24.737980 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:17:24.738380 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-7b59f7a2-164b-4b28-a7e6-aa02f3d9648d tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:18:55.920347 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:18:56.943589 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52328. Dec 16 20:19:22.651600 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:19:22.652455 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:19:22.652455 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:19:22.809441 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 6876409a-1ce1-4354-aec9-8494d4b14fc3] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:19:23.196265 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] Created allocations for migration eda64876-cc67-41dc-a473-0600976e1c11 on 8e84d651-779a-4758-88f8-6acb550f8a09 {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:19:23.552545 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-2d21d7c9-0afd-4f77-bed7-6185aff7470f tempest-ServerActionsTestJSON-239203933 tempest-ServerActionsTestJSON-239203933-project] [instance: 6876409a-1ce1-4354-aec9-8494d4b14fc3] Calling prep_resize with selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"8e84d651-779a-4758-88f8-6acb550f8a09": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["8e84d651-779a-4758-88f8-6acb550f8a09"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=8e84d651-779a-4758-88f8-6acb550f8a09,limits=SchedulerLimits,nodename='n-h2-816927-6',service_host='n-h2-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:19:29.693020 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:19:30.715921 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52454. Dec 16 20:19:31.825352 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:19:34.967242 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:19:39.668140 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:19:40.686866 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52480. Dec 16 20:19:59.335371 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:20:00.236695 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:20:00.351717 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52530. Dec 16 20:20:20.975401 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:20:22.000998 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52586. Dec 16 20:20:26.424792 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:21:28.007011 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:21:29.496222 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:21:30.812340 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:21:31.836230 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52734. Dec 16 20:21:56.941193 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:21:57.958689 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52786. Dec 16 20:22:30.710175 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:22:31.732957 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52864. Dec 16 20:22:40.687670 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:22:41.715649 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52884. Dec 16 20:22:51.846406 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:22:54.987986 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:23:00.353580 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:23:01.369601 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52930. Dec 16 20:23:20.255247 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:23:21.998124 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:23:23.015323 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 52974. Dec 16 20:23:46.444283 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:24:31.831237 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:24:32.852702 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53114. Dec 16 20:24:48.035956 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:24:49.515172 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:24:57.959582 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:24:58.977501 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53174. Dec 16 20:25:31.732721 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:25:32.758317 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53248. Dec 16 20:25:41.719211 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:25:42.738852 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53268. Dec 16 20:26:01.370063 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:26:02.386966 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53314. Dec 16 20:26:11.863980 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:26:15.010792 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:26:23.016837 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:26:24.031962 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53366. Dec 16 20:26:40.275341 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:27:06.462158 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:27:32.850419 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:27:33.871412 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53504. Dec 16 20:27:58.979365 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:27:59.996625 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53554. Dec 16 20:28:08.063964 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:28:09.532935 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:28:32.755827 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:28:33.776950 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53626. Dec 16 20:28:42.740965 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:28:43.758129 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53646. Dec 16 20:29:02.388441 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:29:03.405365 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53686. Dec 16 20:29:24.034045 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:29:25.049731 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53728. Dec 16 20:29:31.883229 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:29:35.030034 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:30:00.293951 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:30:26.484311 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:30:33.868871 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:30:34.890379 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53878. Dec 16 20:30:59.998070 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:31:01.014886 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 53926. Dec 16 20:31:28.091954 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:31:29.551999 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:31:33.779681 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:31:34.806316 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54000. Dec 16 20:31:43.758535 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:31:44.774185 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54020. Dec 16 20:32:03.406288 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:32:04.422521 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54058. Dec 16 20:32:25.051109 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:32:26.065954 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54102. Dec 16 20:32:51.902826 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:32:55.051665 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:33:20.312012 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:33:34.885239 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:33:35.909138 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54244. Dec 16 20:33:46.504501 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:34:01.017385 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:34:02.034502 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54300. Dec 16 20:34:34.796819 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:34:35.823201 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54372. Dec 16 20:34:44.776011 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:34:45.791555 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54392. Dec 16 20:34:48.111956 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:34:49.571785 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:35:04.424299 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:35:05.444355 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54438. Dec 16 20:35:26.067040 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:35:27.085494 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54478. Dec 16 20:36:11.924560 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:36:15.072863 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:36:35.904123 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:36:36.925783 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54622. Dec 16 20:36:40.334343 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:37:02.035279 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:37:03.053546 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54674. Dec 16 20:37:06.522541 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:37:35.815936 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:37:36.839212 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54742. Dec 16 20:37:45.793587 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:37:46.810267 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54762. Dec 16 20:38:05.442846 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:38:06.459994 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54800. Dec 16 20:38:08.135808 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:09.591756 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:38:26.892845 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:38:26.915274 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:26.916288 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:26.970822 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:26.971232 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:26.971989 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:26.972375 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:26.988701 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Getting quotas for project e61202e8ccd946bfb6019671fbfcf00c. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:38:26.993247 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Getting quotas for user c9db0b5f37214e9e8a752b60d8e5860c and project e61202e8ccd946bfb6019671fbfcf00c. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:38:27.005983 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] [instance: 9ebe41fe-72c9-493f-a409-22d306200731] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:38:27.007264 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:27.007830 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:27.015924 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] [instance: 9ebe41fe-72c9-493f-a409-22d306200731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:38:27.017345 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:27.017748 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:27.049539 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:27.049994 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-ed9eb90d-56e5-41b0-a7d2-db5bab2708e5 tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:27.086276 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:38:28.106343 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 54976. Dec 16 20:38:38.080895 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:38:38.103157 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.103589 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:38.152762 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.153109 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:38.153957 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.154200 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:38.171050 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Getting quotas for project e61202e8ccd946bfb6019671fbfcf00c. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:38:38.176011 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Getting quotas for user c9db0b5f37214e9e8a752b60d8e5860c and project e61202e8ccd946bfb6019671fbfcf00c. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:38:38.187572 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] [instance: 1a917a53-3e79-4aea-8b36-fa9479b0c0d0] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:38:38.188518 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.188920 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:38.196387 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] [instance: 1a917a53-3e79-4aea-8b36-fa9479b0c0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:38:38.197670 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.198064 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:38:38.227598 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:38:38.228400 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-d0da6739-843e-4d4b-a623-c22659040cab tempest-ServersNegativeTestJSON-1082098582 tempest-ServersNegativeTestJSON-1082098582-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.043511 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:39:40.066019 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.066428 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.114926 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.115232 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.115995 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.116379 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.131211 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Getting quotas for project 8a191204445746c7ad5e5a81b5f1f7b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:39:40.135763 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Getting quotas for user d9dea77889784a7194eac7714aa84181 and project 8a191204445746c7ad5e5a81b5f1f7b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:39:40.145897 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] [instance: beb37ad7-f411-4b26-a358-5871241ae90c] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:39:40.146809 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.147212 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.154141 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] [instance: beb37ad7-f411-4b26-a358-5871241ae90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:39:40.155329 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.155746 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:39:40.181992 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:39:40.182410 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-d1e98919-adae-42cf-b141-a6a6d3b18839 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:00.352253 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:40:12.497349 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:40:12.520063 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.520467 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:12.563113 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.563559 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:12.564263 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.564667 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:12.580543 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Getting quotas for project 8a191204445746c7ad5e5a81b5f1f7b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:40:12.585248 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Getting quotas for user d9dea77889784a7194eac7714aa84181 and project 8a191204445746c7ad5e5a81b5f1f7b4. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:40:12.595575 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] [instance: fbed0150-a904-4843-8487-3d65fac4eabd] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:40:12.596510 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.596923 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:12.603358 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] [instance: fbed0150-a904-4843-8487-3d65fac4eabd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:40:12.604491 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.604893 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:12.630715 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:40:12.631135 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-70d7d870-757d-4521-807a-ec5a3b602eb5 tempest-TestEncryptedCinderVolumes-1419128091 tempest-TestEncryptedCinderVolumes-1419128091-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:40:26.548011 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:41:06.460976 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:41:07.476592 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55802. Dec 16 20:41:19.721688 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:41:19.746388 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.746891 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:19.811459 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.811832 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:19.812549 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.813093 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:19.830234 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Getting quotas for project c907e6592a17469fa9bafe0ef60079eb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:41:19.835845 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Getting quotas for user 37b4c3f6f5114a7cb516e26d603bc50b and project c907e6592a17469fa9bafe0ef60079eb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:41:19.848461 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] [instance: 5dbff093-d1b1-4b05-ad0f-6318415a9ac4] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:41:19.849585 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.849980 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:19.857116 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] [instance: 5dbff093-d1b1-4b05-ad0f-6318415a9ac4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='311f255e-c987-4295-b8b9-adcb7f9465bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:41:19.858318 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.858710 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:19.888332 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:41:19.888665 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-46ca4970-d05d-40ba-b5e2-1abf37cd64ef tempest-TestMinimumBasicScenario-1690749318 tempest-TestMinimumBasicScenario-1690749318-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:41:28.108458 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:41:29.129682 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 55904. Dec 16 20:42:36.836655 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:42:37.857567 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56070. Dec 16 20:42:46.815176 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:42:47.831498 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56072. Dec 16 20:42:55.105029 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:43:20.370583 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:43:34.173344 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Took 0.56 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:43:34.195238 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.195683 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:34.245217 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.245862 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:34.246745 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.247281 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:34.263664 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:43:34.268271 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for user c07872dd5277420d94d9b6f28d6ac44f and project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:43:34.278920 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 9b19b4ee-2b45-4821-ae1c-f71d0162169e] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:43:34.279949 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.280357 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:34.288599 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 9b19b4ee-2b45-4821-ae1c-f71d0162169e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:43:34.289907 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.290307 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:34.322242 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:43:34.322734 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-b80267c3-45c3-46e7-b3d0-bfd48e0f38f9 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:43:46.575973 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:44:07.477610 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:44:08.493298 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56444. Dec 16 20:44:29.129922 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:44:30.145281 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56464. Dec 16 20:45:18.930453 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:45:19.947400 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56612. Dec 16 20:45:20.177109 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Took 1.25 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:45:20.200806 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.201411 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:20.247257 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.247688 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:20.248408 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.248798 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:20.264049 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:45:20.269035 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for user c07872dd5277420d94d9b6f28d6ac44f and project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:45:20.280370 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 1a1a2850-ab7e-41e7-85e1-cc11bf040ae3] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:45:20.281350 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.281752 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:20.288628 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 1a1a2850-ab7e-41e7-85e1-cc11bf040ae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:45:20.289832 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.290238 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:20.318280 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:45:20.318680 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-76744fee-f6e1-417b-8813-de2da1ceab8d tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:45:36.927185 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:45:37.946777 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56678. Dec 16 20:46:03.059051 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:46:04.075508 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56700. Dec 16 20:46:28.167949 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:46:29.619716 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:46:40.391761 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:47:06.595690 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:47:08.495364 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:47:09.513737 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56842. Dec 16 20:47:15.969026 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:47:15.991021 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:15.991450 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:16.039215 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:16.039674 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:16.040401 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:16.040819 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:16.056730 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:47:16.063644 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for user c07872dd5277420d94d9b6f28d6ac44f and project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:47:16.074699 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 0570d517-5f54-40a5-bfa8-e720d7d1e418] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:47:16.076280 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:16.076681 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:16.083438 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 0570d517-5f54-40a5-bfa8-e720d7d1e418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:47:16.085000 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:16.085473 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:16.115061 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:47:16.115674 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-290643c6-ff25-446a-98c7-32b637ff832f tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:47:30.148303 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:47:31.164663 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 56926. Dec 16 20:48:32.995121 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method migrate_server {{(pid=89923) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:48:32.995757 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:48:32.996566 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:48:33.365906 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 0570d517-5f54-40a5-bfa8-e720d7d1e418] Restricting to cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) while migrating {{(pid=89923) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:208}} Dec 16 20:48:33.646971 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Created allocations for migration 0f437b9f-79fe-4524-b8bf-2ebce06c8c95 on fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa {{(pid=89923) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Dec 16 20:48:34.098803 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.tasks.migrate [None req-fddd1ba1-5c00-4e66-a6f7-22b6f31d2876 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: 0570d517-5f54-40a5-bfa8-e720d7d1e418] Calling prep_resize with selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [Selection(allocation_request='{"allocations": {"fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=95157219-854e-48e1-b9a7-81818c76ca64,compute_node_uuid=fa0ff1d2-e75b-4c94-b0cd-8b2f99205bfa,limits=SchedulerLimits,nodename='n-h1-816927-6',service_host='n-h1-816927-6')] {{(pid=89923) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:415}} Dec 16 20:49:31.965580 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:49:37.859240 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:49:38.884304 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57158. Dec 16 20:49:45.097610 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:49:45.123852 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.124348 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:45.174054 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.174448 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:45.175164 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.175572 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:45.191282 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:49:45.196398 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for user c07872dd5277420d94d9b6f28d6ac44f and project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:49:45.207552 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: f19f5ec4-c06d-445c-b69f-1510a4e544f1] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:49:45.208484 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.208906 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:45.216912 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: f19f5ec4-c06d-445c-b69f-1510a4e544f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:49:45.218829 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.219766 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:45.248188 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:49:45.248598 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-3b8bc9c0-6b79-4a7b-8b4d-2a6fccad9a01 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:49:47.839288 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:49:48.854895 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57210. Dec 16 20:50:00.409699 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:50:09.512932 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:50:10.529098 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57262. Dec 16 20:50:26.622478 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:50:31.165892 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:50:32.182143 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57290. Dec 16 20:51:40.144720 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:51:40.166917 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.167399 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:51:40.214663 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.215060 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:51:40.215817 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.216206 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:51:40.230833 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:51:40.235194 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Getting quotas for user c07872dd5277420d94d9b6f28d6ac44f and project fc3778a6c6c04a5cb8bc3b5291352426. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:51:40.245834 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: d3d8a5cb-a46e-4dd2-a5ed-a7f06ef6f1d7] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:51:40.246716 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.247111 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:51:40.254420 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] [instance: d3d8a5cb-a46e-4dd2-a5ed-a7f06ef6f1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:51:40.255600 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.255998 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:51:40.283362 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:51:40.283881 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-c36218eb-3378-4083-9900-4ba3e816dc94 tempest-TestNetworkAdvancedServerOps-1438371366 tempest-TestNetworkAdvancedServerOps-1438371366-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:52:04.079646 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:52:05.095347 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57542. Dec 16 20:52:37.947052 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:52:38.968603 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57554. Dec 16 20:53:10.530718 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:53:11.547721 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57616. Dec 16 20:53:20.428758 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:53:32.184392 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:53:33.202308 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57760. Dec 16 20:53:34.909027 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:53:34.931020 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:34.931435 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:34.982412 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:34.983116 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:34.984184 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:34.984750 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:35.002276 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Getting quotas for project 2a352ba97d1248438efcbe0b02365edb. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:53:35.007508 n-d-816927-6 nova-conductor[89924]: DEBUG nova.quota [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Getting quotas for user f742179a56d8447a91b2591be79b9e0d and project 2a352ba97d1248438efcbe0b02365edb. Resources: {'instances', 'cores', 'ram'} {{(pid=89924) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:53:35.018422 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: c0970eff-96bb-4b7e-bd1b-5917a7891dab] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89924) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:53:35.019255 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:35.019740 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:35.026070 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: c0970eff-96bb-4b7e-bd1b-5917a7891dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89924) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:53:35.027480 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:35.027860 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:35.053795 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:53:35.054225 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-f6057d33-3097-4c13-b15b-26e297bc6916 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:53:46.644428 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:54:48.204603 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:54:49.645956 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:55:05.097488 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:55:06.116409 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57880. Dec 16 20:55:38.880797 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:55:38.965180 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:55:39.902255 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57894. Dec 16 20:55:39.987669 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57896. Dec 16 20:55:48.860270 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:55:49.876102 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 57952. Dec 16 20:56:09.389428 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method unshelve_instance {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 20:56:09.390048 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:56:09.390289 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:56:09.622944 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: c0970eff-96bb-4b7e-bd1b-5917a7891dab] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) during scheduling {{(pid=89924) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 20:56:11.547958 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:56:11.860540 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Took 2.23 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:56:11.875903 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [2a6041c4-56f4-4504-9355-bec2079689c4] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:56:12.564983 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58062. Dec 16 20:56:12.891917 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-eb7c031b-2797-45a9-9132-afcc37af1dcf tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [2a6041c4-56f4-4504-9355-bec2079689c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58064. Dec 16 20:56:33.203064 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:56:34.218177 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58154. Dec 16 20:56:40.450089 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:57:06.668580 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 20:58:06.115049 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:58:06.948674 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [f54ec107-3662-4aa8-a027-bd1658be3345] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:58:07.131225 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58328. Dec 16 20:58:07.967185 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [f54ec107-3662-4aa8-a027-bd1658be3345] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58330. Dec 16 20:58:09.339393 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Took 2.40 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 20:58:09.364316 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.364719 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.414269 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.414691 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.415454 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.415849 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.433993 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Getting quotas for project 2a352ba97d1248438efcbe0b02365edb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 20:58:09.438657 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Getting quotas for user f742179a56d8447a91b2591be79b9e0d and project 2a352ba97d1248438efcbe0b02365edb. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 20:58:09.450212 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: 2843647f-a940-473a-8f78-088e39485618] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 20:58:09.451180 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.451630 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.458343 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: 2843647f-a940-473a-8f78-088e39485618] block_device_mapping [BlockDeviceMapping(attachment_id=165474bd-0fa2-4727-a919-e739d07f9f76,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36b102cb-06f3-4520-8edd-5ba3f2a1e503',volume_size=1,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 20:58:09.459593 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.460060 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.488458 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 20:58:09.488864 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 20:58:09.497621 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [0048456c-86e4-4107-98b1-d57bac6f1f33] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 20:58:10.513026 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [None req-a99594bf-9c6f-429f-bc58-735cf7a73bc4 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [0048456c-86e4-4107-98b1-d57bac6f1f33] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58360. Dec 16 20:58:39.899851 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:58:40.922752 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58410. Dec 16 20:58:49.884720 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 20:58:50.896012 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58416. Dec 16 20:59:12.564990 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:59:13.581970 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58428. Dec 16 20:59:34.218919 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 20:59:35.234979 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58430. Dec 16 21:00:00.470339 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:00:26.688110 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:00:39.986485 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:00:41.011077 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58486. Dec 16 21:00:42.501206 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Targeting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) for conductor method unshelve_instance {{(pid=89924) wrapper /opt/stack/nova/nova/conductor/manager.py:92}} Dec 16 21:00:42.501766 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:00:42.502250 n-d-816927-6 nova-conductor[89924]: DEBUG oslo_concurrency.lockutils [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:00:42.604421 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [instance: 2843647f-a940-473a-8f78-088e39485618] Requesting cell 95157219-854e-48e1-b9a7-81818c76ca64(cell1) during scheduling {{(pid=89924) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:903}} Dec 16 21:00:42.613606 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 21:00:43.628796 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [9c4e4e73-6bf1-475c-9bd7-78030c931aa7] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58496. Dec 16 21:00:46.034711 n-d-816927-6 nova-conductor[89924]: DEBUG nova.conductor.manager [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] Took 3.43 seconds to select destinations for 1 instance(s). {{(pid=89924) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 21:00:46.049518 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [2a6041c4-56f4-4504-9355-bec2079689c4] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 21:00:47.064681 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [None req-8b45d241-28e5-43fe-8d42-48877961b0e7 tempest-TestShelveInstance-258244723 tempest-TestShelveInstance-258244723-project] [2a6041c4-56f4-4504-9355-bec2079689c4] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58522. Dec 16 21:01:07.133061 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:01:08.148681 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58564. Dec 16 21:02:13.583643 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:02:14.600503 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58580. Dec 16 21:02:35.237543 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:02:36.257983 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58626. Dec 16 21:02:50.899100 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:02:51.922530 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58712. Dec 16 21:03:02.044746 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [f54ec107-3662-4aa8-a027-bd1658be3345] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 21:03:03.060430 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [f54ec107-3662-4aa8-a027-bd1658be3345] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58796. Dec 16 21:03:03.296513 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Took 1.26 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 21:03:03.319840 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.320496 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.369135 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.369525 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.370236 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.370617 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.386299 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Getting quotas for project a041f374d0754da5bcdc647dd40bebe1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 21:03:03.391327 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Getting quotas for user 8af964ed94f147c6ace70213e18bbab2 and project a041f374d0754da5bcdc647dd40bebe1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 21:03:03.402787 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [instance: 65a3737b-7e98-4aa9-a0c7-661882bd1445] Selected host: n-h2-816927-6; Selected node: n-h2-816927-6; Alternates: [('n-h1-816927-6', 'n-h1-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 21:03:03.403756 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.404150 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.411147 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [instance: 65a3737b-7e98-4aa9-a0c7-661882bd1445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2d8f9386-43ef-4848-b207-e3fe19e490fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 21:03:03.412370 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.412769 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.446040 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:03:03.446525 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:03:03.456349 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [0048456c-86e4-4107-98b1-d57bac6f1f33] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 16 21:03:04.471857 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [None req-9de657eb-d3c6-4a79-b7e9-43be0d0c86f0 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [0048456c-86e4-4107-98b1-d57bac6f1f33] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58810. Dec 16 21:03:20.495114 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:03:40.921402 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:03:41.945954 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58866. Dec 16 21:03:46.711973 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:05:08.151476 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:05:09.168171 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58880. Dec 16 21:05:14.600865 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:05:15.619067 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 58894. Dec 16 21:05:29.267091 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=89923) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:885}} Dec 16 21:05:29.289717 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.290112 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:29.355394 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.355932 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:29.356786 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.357190 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:29.374263 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Getting quotas for project a041f374d0754da5bcdc647dd40bebe1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 16 21:05:29.380849 n-d-816927-6 nova-conductor[89923]: DEBUG nova.quota [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Getting quotas for user 8af964ed94f147c6ace70213e18bbab2 and project a041f374d0754da5bcdc647dd40bebe1. Resources: {'instances', 'cores', 'ram'} {{(pid=89923) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 16 21:05:29.391496 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [instance: 856cabe5-f740-4dc4-be1a-fd916722453e] Selected host: n-h1-816927-6; Selected node: n-h1-816927-6; Alternates: [('n-h2-816927-6', 'n-h2-816927-6')] {{(pid=89923) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1620}} Dec 16 21:05:29.392366 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.392766 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:29.400365 n-d-816927-6 nova-conductor[89923]: DEBUG nova.conductor.manager [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] [instance: 856cabe5-f740-4dc4-be1a-fd916722453e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c8bee78-ce47-43b4-83c2-1e3f99bc6ebb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=89923) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1363}} Dec 16 21:05:29.401645 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.402108 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:29.431259 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Dec 16 21:05:29.431901 n-d-816927-6 nova-conductor[89923]: DEBUG oslo_concurrency.lockutils [None req-316ac3c7-bed7-4d5e-acfd-6baed8cbdc40 tempest-TestSnapshotPattern-72281887 tempest-TestSnapshotPattern-72281887-project] Lock "95157219-854e-48e1-b9a7-81818c76ca64" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=89923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Dec 16 21:05:36.257678 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:05:37.292083 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59034. Dec 16 21:05:51.920300 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:05:52.939715 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59078. Dec 16 21:06:12.008936 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:06:15.167905 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:06:40.517155 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:06:41.941778 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:06:42.964855 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59118. Dec 16 21:07:06.730151 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:07:41.010072 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:07:42.032759 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59136. Dec 16 21:08:08.251874 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:08:09.169940 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:08:10.185952 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59148. Dec 16 21:08:10.535929 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:08:15.620003 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:08:16.638499 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59172. Dec 16 21:08:37.292857 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:08:38.311091 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59356. Dec 16 21:08:52.940930 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:08:53.977886 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59414. Dec 16 21:09:32.031522 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:09:35.190530 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:09:42.960292 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:09:43.985052 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59452. Dec 16 21:10:00.538085 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:10:26.753545 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:10:42.028222 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:10:43.048763 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59460. Dec 16 21:11:10.187833 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:11:11.204417 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59462. Dec 16 21:11:16.640030 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:11:17.657074 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59464. Dec 16 21:11:28.271802 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:11:30.553825 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:11:38.310918 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:11:39.328194 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59474. Dec 16 21:11:53.975980 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:11:54.995210 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59476. Dec 16 21:12:43.978958 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:12:45.001924 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59480. Dec 16 21:12:52.051966 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:12:55.208275 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:13:20.558341 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:13:43.046292 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:13:44.069884 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59496. Dec 16 21:13:46.774383 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:14:11.206939 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:14:12.223125 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59500. Dec 16 21:14:17.659654 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:14:18.675230 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59504. Dec 16 21:14:39.329755 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:14:40.345995 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [78f3b53e-fc37-4a90-bf5b-ee18905597ca] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59506. Dec 16 21:14:48.295170 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:14:50.573037 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:14:54.996200 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:14:56.012883 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [5332bedb-7178-4a30-86d1-7c8bd5614a0c] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59516. Dec 16 21:15:44.996485 n-d-816927-6 nova-conductor[89924]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 16 21:15:46.018308 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] [ccb4d50f-e526-489c-b613-f0de91c37420] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59520. Dec 16 21:16:12.072613 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:16:15.228729 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:16:40.577344 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:16:44.065203 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:16:45.091758 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [0461c23f-d868-4ce5-97f0-022f4d430379] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59534. Dec 16 21:17:06.793424 n-d-816927-6 nova-conductor[89924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 16 21:17:12.225008 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:17:13.244863 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [430cd70f-63ae-4fff-bb3f-9b69b265e31f] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59538. Dec 16 21:17:18.677520 n-d-816927-6 nova-conductor[89923]: ERROR oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] AMQP server on 10.222.0.73:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Dec 16 21:17:19.694930 n-d-816927-6 nova-conductor[89923]: INFO oslo.messaging._drivers.impl_rabbit [-] [10717f67-8e15-473a-82f2-77dd3c16e4d9] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 59540.