-- Logs begin at Mon 2021-07-26 02:46:51 UTC, end at Mon 2021-07-26 05:50:03 UTC. -- Jul 26 03:19:11.019215 n-d-802225-1 systemd[1]: Started Devstack devstack@n-super-cond.service. Jul 26 03:19:14.759735 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:19:14.834909 n-d-802225-1 nova-conductor[99120]: DEBUG nova.context [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cdbe4959-2833-4606-a027-7c38eb82690c(cell1) {{(pid=99120) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 03:19:14.838563 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:19:14.840005 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:19:14.840758 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:19:14.842507 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:19:14.858161 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:19:14.864918 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_db.sqlalchemy.engines [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:19:15.095980 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Acquired lock "singleton_lock" {{(pid=99120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 26 03:19:15.096601 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_concurrency.lockutils [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Releasing lock "singleton_lock" {{(pid=99120) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 26 03:19:15.097379 n-d-802225-1 nova-conductor[99120]: INFO oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Starting 2 workers Jul 26 03:19:15.102115 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Started child 99991 {{(pid=99120) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 26 03:19:15.106806 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Started child 99992 {{(pid=99120) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Jul 26 03:19:15.108104 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Full set of CONF: {{(pid=99120) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Jul 26 03:19:15.108513 n-d-802225-1 nova-conductor[99991]: INFO nova.service [-] Starting conductor node (version 23.1.0) Jul 26 03:19:15.109108 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ******************************************************************************** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 03:19:15.109108 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] Configuration options gathered from: {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 03:19:15.109600 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 03:19:15.110996 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] config files: ['/etc/nova/nova.conf'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 03:19:15.111430 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ================================================================================ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 03:19:15.112369 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] allow_resize_to_same_host = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.112977 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] arq_binding_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.113539 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] block_device_allocate_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.114078 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] block_device_allocate_retries_interval = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.121147 n-d-802225-1 nova-conductor[99992]: INFO nova.service [-] Starting conductor node (version 23.1.0) Jul 26 03:19:15.122351 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cert = self.pem {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.122918 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute_driver = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.123519 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute_monitors = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.124133 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] config_dir = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.124714 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] config_drive_format = iso9660 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.125242 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.125688 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] config_source = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.126343 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] console_host = n-d-802225-1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.126895 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] control_exchange = nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.127463 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cpu_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.127998 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] daemon = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.128595 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] debug = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.132468 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] default_access_ip_network_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.132468 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] default_availability_zone = nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.132468 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] default_ephemeral_format = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.132468 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.134092 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] default_schedule_zone = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.134581 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_db.sqlalchemy.engines [None req-37022540-fd20-4e02-9359-4b4be7fb6c22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:19:15.137120 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] disk_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.137120 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] enable_new_services = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.138480 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] enabled_apis = ['osapi_compute'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.139007 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] enabled_ssl_apis = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.142848 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] flat_injected = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.143421 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] force_config_drive = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.143938 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] force_raw_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.144500 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] graceful_shutdown_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.145010 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] heal_instance_info_cache_interval = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.145912 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] host = n-d-802225-1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.149017 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] initial_cpu_allocation_ratio = 16.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.149441 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] initial_disk_allocation_ratio = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.149863 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] initial_ram_allocation_ratio = 1.5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.150454 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.150857 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_build_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.151265 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_delete_interval = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.151706 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_format = [instance: %(uuid)s] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.152103 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_name_template = instance-%08x {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.156674 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_usage_audit = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.157734 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_usage_audit_period = month {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.158146 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.158573 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] instances_path = /opt/stack/data/nova/instances {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.158983 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] internal_service_availability_zone = internal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.159384 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.159787 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] live_migration_retry_count = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.160180 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_config_append = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.160619 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.161015 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe4c4b4-81cb-450f-bfab-6480931a5049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:19:15.161129 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_dir = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.161395 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.161723 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_options = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.162099 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_rotate_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.162526 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_rotate_interval_type = days {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.162939 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] log_rotation_type = none {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.163266 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.163587 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.163993 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.164414 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.164761 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.165182 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] long_rpc_timeout = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.165560 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_concurrent_builds = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.165953 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_concurrent_live_migrations = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.166350 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_concurrent_snapshots = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.167071 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_local_block_devices = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.167179 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_logfile_count = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.167519 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] max_logfile_size_mb = 200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.167898 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] maximum_instance_delete_attempts = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.168294 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metadata_listen = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.181005 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metadata_listen_port = 8775 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.181465 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metadata_workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.181908 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] migrate_max_retries = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.182297 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] mkisofs_cmd = genisoimage {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.182801 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] my_block_storage_ip = 10.222.0.22 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.183128 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] my_ip = 10.222.0.22 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.183525 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] network_allocate_retries = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.183964 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.184367 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] osapi_compute_listen = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.189713 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] osapi_compute_listen_port = 8774 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.190595 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] osapi_compute_unique_server_name_scope = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.191166 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] osapi_compute_workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.191940 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] password_length = 12 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.192578 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] periodic_enable = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.193200 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] periodic_fuzzy_delay = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.193993 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] pointer_model = usbtablet {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.194750 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] preallocate_images = none {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.195295 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] publish_errors = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.198226 n-d-802225-1 nova-conductor[99991]: DEBUG nova.service [None req-37022540-fd20-4e02-9359-4b4be7fb6c22 None None] Creating RPC server for service conductor {{(pid=99991) start /opt/stack/nova/nova/service.py:182}} Jul 26 03:19:15.202148 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] pybasedir = /opt/stack/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.202762 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ram_allocation_ratio = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.203725 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rate_limit_burst = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.205062 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rate_limit_except_level = CRITICAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.205881 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rate_limit_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.206486 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reboot_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.207118 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reclaim_instance_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.211712 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] record = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.212370 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] report_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.213683 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rescue_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.214882 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reserved_host_cpus = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.215740 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reserved_host_disk_mb = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.217156 n-d-802225-1 nova-conductor[99992]: DEBUG nova.service [None req-4fe4c4b4-81cb-450f-bfab-6480931a5049 None None] Creating RPC server for service conductor {{(pid=99992) start /opt/stack/nova/nova/service.py:182}} Jul 26 03:19:15.217817 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reserved_host_memory_mb = 512 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.218420 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] reserved_huge_pages = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.220127 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] resize_confirm_window = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.220759 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] resize_fs_using_block_device = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.223981 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] resume_guests_state_on_host_boot = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.224628 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.225239 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rpc_response_timeout = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.225876 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] run_external_periodic_tasks = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.226472 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] running_deleted_instance_action = reap {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.227068 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.227719 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] running_deleted_instance_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.228322 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler_instance_sync_interval = 120 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.228918 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_down_time = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.229539 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] servicegroup_driver = db {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.230125 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] shelved_offload_time = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.230707 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] shelved_poll_interval = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.231295 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] shutdown_timeout = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.231913 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] source_is_ipv6 = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.232510 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ssl_only = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.233158 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] state_path = /opt/stack/data/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.233722 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] sync_power_state_interval = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.234338 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] sync_power_state_pool_size = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.234915 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] syslog_log_facility = LOG_USER {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.236219 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] tempdir = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.236844 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] timeout_nbd = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.237504 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] transport_url = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.238070 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] update_resources_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.238635 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_cow_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.239204 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_eventlog = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.239795 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_journal = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.240430 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_json = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.241042 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_rootwrap_daemon = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.241656 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_stderr = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.242220 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] use_syslog = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.242798 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vcpu_pin_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.243385 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vif_plugging_is_fatal = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.244362 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vif_plugging_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.245003 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] virt_mkfs = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.245590 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] volume_usage_poll_interval = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.246170 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] watch_log_file = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.246776 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] web = /usr/share/spice-html5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 03:19:15.247489 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_concurrency.disable_process_locking = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.248139 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.249026 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.auth_strategy = keystone {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.249606 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.compute_link_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.250194 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.250930 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.dhcp_domain = novalocal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.251503 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.enable_instance_password = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.252111 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.glance_link_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.253415 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.254029 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.254930 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.instance_list_per_project_cells = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.256080 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.list_records_by_skipping_down_cells = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.256698 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.local_metadata_per_cell = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.257295 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.max_limit = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.257868 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.metadata_cache_expiration = 15 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.258444 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.neutron_default_tenant_id = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.259038 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.use_forwarded_for = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.259897 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.use_neutron_default_nets = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.260529 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.261109 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.261681 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.262289 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.262896 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_dynamic_targets = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.263458 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_jsonfile_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.264061 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.264758 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.backend = dogpile.cache.memcached {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.265346 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.backend_argument = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.266337 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.config_prefix = cache.oslo {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.267749 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.debug_cache_backend = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.268374 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.268994 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.expiration_time = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.269590 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_dead_retry = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.270163 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.270420 n-d-802225-1 nova-conductor[99991]: DEBUG nova.service [None req-37022540-fd20-4e02-9359-4b4be7fb6c22 None None] Join ServiceGroup membership for this service conductor {{(pid=99991) start /opt/stack/nova/nova/service.py:199}} Jul 26 03:19:15.270913 n-d-802225-1 nova-conductor[99991]: DEBUG nova.servicegroup.drivers.db [None req-37022540-fd20-4e02-9359-4b4be7fb6c22 None None] DB_Driver: join new ServiceGroup member n-d-802225-1 to the conductor group, service = {{(pid=99991) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 26 03:19:15.271088 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.271655 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_pool_maxsize = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.272222 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.272920 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.273520 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.memcache_socket_timeout = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.274095 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.proxies = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.274671 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.tls_allowed_ciphers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.275127 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.tls_cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.275677 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.tls_certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.276072 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.tls_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.276542 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cache.tls_keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.277016 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.277443 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.278254 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.278691 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.catalog_info = volumev3::publicURL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.279122 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.279539 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.279930 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.cross_az_attach = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.280356 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.endpoint_template = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.280772 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.http_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.281161 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.281552 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.282408 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.os_region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.282803 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.283227 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cinder.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.283606 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.283986 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.cpu_dedicated_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.284958 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.cpu_shared_set = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.285355 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.image_type_exclude_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.285769 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.286154 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.286542 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.286944 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.287334 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.resource_provider_association_refresh = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.287725 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] compute.shutdown_retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.288138 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] conductor.workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.288600 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] console.allowed_origins = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.289025 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] console.ssl_ciphers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.289443 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] console.ssl_minimum_version = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.289874 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] consoleauth.token_ttl = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.290590 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.291136 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.291682 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.293337 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.293896 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.294444 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.294976 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.295508 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.296049 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.296616 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.296998 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.297388 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.298335 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.service_type = accelerator {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.298872 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.299406 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.299790 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.300344 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.300829 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.301207 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] cyborg.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.301805 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.302220 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.connection_debug = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.302625 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.connection_parameters = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.303019 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.connection_recycle_time = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.303666 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.connection_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.304061 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.max_overflow = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.304699 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.max_pool_size = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.305094 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.max_retries = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.305498 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.306342 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.pool_timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.306640 n-d-802225-1 nova-conductor[99992]: DEBUG nova.service [None req-4fe4c4b4-81cb-450f-bfab-6480931a5049 None None] Join ServiceGroup membership for this service conductor {{(pid=99992) start /opt/stack/nova/nova/service.py:199}} Jul 26 03:19:15.307038 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.307238 n-d-802225-1 nova-conductor[99992]: DEBUG nova.servicegroup.drivers.db [None req-4fe4c4b4-81cb-450f-bfab-6480931a5049 None None] DB_Driver: join new ServiceGroup member n-d-802225-1 to the conductor group, service = {{(pid=99992) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jul 26 03:19:15.307741 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.slave_connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.309065 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] api_database.sqlite_synchronous = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.309647 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] devices.enabled_vgpu_types = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.310083 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.310481 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ephemeral_storage_encryption.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.310872 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.311302 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.api_servers = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.311706 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.312100 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.312539 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.313092 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.313603 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.314027 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.debug = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.314414 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.default_trusted_certificate_ids = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.314811 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.enable_certificate_validation = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.315197 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.enable_rbd_download = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.315577 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.315963 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.316531 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.316913 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.317292 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.317676 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.num_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.318077 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.rbd_ceph_conf = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.318460 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.rbd_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.318855 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.rbd_pool = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.319248 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.rbd_user = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.319624 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.319999 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.320397 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.service_type = image {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.320823 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.321220 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.321607 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.321985 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.322413 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.322803 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.verify_glance_signatures = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.323178 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] glance.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.323575 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] guestfs.debug = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.324012 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.config_drive_cdrom = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.324415 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.config_drive_inject_password = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.324893 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.325280 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.325666 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.enable_remotefx = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.326075 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.instances_path_share = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.326503 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.iscsi_initiator_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.326894 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.limit_cpu_features = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.327302 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.327686 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.328073 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.328505 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.329436 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.329883 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.use_multipath_io = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.330268 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.330651 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.331029 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.vswitch_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.331411 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.331811 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] mks.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.332927 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.333336 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.manager_interval = 2400 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.333747 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.precache_concurrency = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.334150 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.remove_unused_base_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.334544 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.334947 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.335357 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] image_cache.subdirectory_name = _base {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.335779 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.api_max_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.336168 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.api_retry_interval = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.336570 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.336979 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.337359 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.337736 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.338117 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.338515 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.338903 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.339275 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.339656 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.340028 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.340403 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.340805 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.341207 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.partition_key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.341580 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.peer_list = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.341958 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.342340 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.serial_console_state_timeout = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.342713 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.343124 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.service_type = baremetal {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.343508 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.343876 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.344253 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.344759 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.345179 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.345626 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ironic.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.346121 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.346518 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] key_manager.fixed_key = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.346993 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.347370 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.barbican_api_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.347750 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.barbican_endpoint = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.348170 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.barbican_endpoint_type = public {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.348590 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.barbican_region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.349001 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.349364 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.349748 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.350156 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.350533 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.350938 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.number_of_retries = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.351320 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.retry_delay = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.351703 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.send_service_user_token = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.352142 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.352604 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.353039 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.verify_ssl = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.353380 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican.verify_ssl_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.353771 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.354151 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.354542 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.354917 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.355298 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.355679 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.356054 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.356464 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.356830 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] barbican_service_user.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.357225 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.approle_role_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.357602 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.approle_secret_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.357979 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.358359 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.358758 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.359147 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.359525 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.359919 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.kv_mountpoint = secret {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.360913 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.kv_version = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.361296 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.root_token_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.361693 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.362086 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.ssl_ca_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.362456 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.362835 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.use_ssl = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.363269 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.363734 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.364065 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.364549 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.364867 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.365243 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.365619 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.365999 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.366373 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.366747 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.367117 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.367492 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.region_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.367869 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.368295 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.service_type = identity {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.368764 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.369150 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.369521 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.369914 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.370321 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.370694 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] keystone.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.371174 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.connection_uri = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.371587 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.cpu_mode = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.371981 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.cpu_model_extra_flags = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.372373 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.cpu_models = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.372815 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.device_detach_attempts = 8 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.373250 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.device_detach_timeout = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.373703 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.disk_cachemodes = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.374115 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.disk_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.374354 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.enabled_perf_events = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.374781 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.file_backed_memory = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.375113 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.gid_maps = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.375528 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.hw_disk_discard = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.376405 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.hw_machine_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.376405 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_rbd_ceph_conf = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.376982 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.377425 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.377832 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_rbd_glance_store_name = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.378367 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_rbd_pool = rbd {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.378736 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_type = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.379187 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.images_volume_group = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.379578 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.inject_key = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.380031 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.inject_partition = -2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.380419 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.inject_password = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.380865 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.iscsi_iface = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.381248 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.iser_use_multipath = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.381655 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.382057 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.382439 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_downtime = 500 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.382830 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.383213 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.383593 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_inbound_addr = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.383970 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.384348 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.384814 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_scheme = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.385173 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_timeout_action = abort {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.385559 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_tunnelled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.385934 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.386319 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.live_migration_with_native_tls = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.386714 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.max_queues = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.387099 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.387471 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.nfs_mount_options = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.388035 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.388419 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.388831 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_iser_scan_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.389208 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.389590 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.389969 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_pcie_ports = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.390452 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.num_volume_scan_tries = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.390767 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.pmem_namespaces = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.391142 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.quobyte_client_cfg = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.392188 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.392759 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rbd_connect_timeout = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.393170 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.393557 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.393932 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rbd_secret_uuid = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.394308 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rbd_user = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.394689 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.395083 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.395459 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rescue_image_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.395833 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rescue_kernel_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.396206 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rescue_ramdisk_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.396632 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.397038 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.rx_queue_size = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.397408 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.smbfs_mount_options = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.397891 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.398276 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.snapshot_compression = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.398655 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.snapshot_image_format = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.399135 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.399516 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.sparse_logical_volumes = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.399901 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.swtpm_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.400332 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.swtpm_group = tss {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.401120 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.swtpm_user = tss {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.401120 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.sysinfo_serial = unique {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.401470 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.tx_queue_size = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.402917 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.uid_maps = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.403288 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.use_virtio_for_bridges = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.403701 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.virt_type = kvm {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.404108 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.volume_clear = zero {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.404530 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.volume_clear_size = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.405032 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.volume_use_multipath = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.405311 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_cache_path = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.405748 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.406113 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_mount_group = qemu {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.406511 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_mount_opts = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.406907 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.407654 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.408062 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.vzstorage_mount_user = stack {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.408460 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.408879 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.409283 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.409665 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.410045 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.410471 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.410806 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.411185 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.411606 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.default_floating_pool = public {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.411984 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.412376 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.extension_sync_interval = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.412788 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.http_retries = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.413175 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.413555 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.413936 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.414329 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.414708 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.415140 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.ovs_bridge = br-int {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.415489 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.physnets = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.415892 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.416289 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.service_metadata_proxy = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.416689 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.417106 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.service_type = network {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.417490 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.417892 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.418270 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.418647 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.419069 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.419447 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] neutron.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.419853 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] notifications.bdms_in_notifications = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.420248 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] notifications.default_level = INFO {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.420676 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] notifications.notification_format = unversioned {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.421060 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] notifications.notify_on_state_change = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.421473 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.421894 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] pci.alias = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.422288 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] pci.passthrough_whitelist = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.423306 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.423886 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.424248 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.auth_url = http://10.222.0.22/identity {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.424686 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.425026 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.425408 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.425786 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.connect_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.426161 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.connect_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.426562 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.default_domain_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.426942 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.default_domain_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.427319 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.domain_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.427694 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.domain_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.428078 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.endpoint_override = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.428472 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.428852 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.429227 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.max_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.429606 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.min_version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.429999 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.password = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.430396 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.project_domain_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.430787 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.project_domain_name = Default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.431173 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.project_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.431570 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.project_name = service {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.431984 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.region_name = RegionOne {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.432358 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.service_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.432778 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.service_type = placement {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.433160 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.433536 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.status_code_retries = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.433909 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.status_code_retry_delay = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.434282 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.system_scope = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.434655 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.435031 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.trust_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.435409 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.user_domain_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.435799 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.user_domain_name = Default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.436200 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.user_id = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.436633 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.username = placement {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.437049 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.437427 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] placement.version = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.437837 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] powervm.disk_driver = localdisk {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.438306 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] powervm.proc_units_factor = 0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.439248 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] powervm.volume_group_name = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.439667 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.cores = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.440058 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.count_usage_from_placement = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.440462 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.440886 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.injected_file_content_bytes = 10240 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.441273 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.injected_file_path_length = 255 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.441665 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.injected_files = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.442052 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.instances = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.442444 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.key_pairs = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.442836 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.metadata_items = 128 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.443236 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.ram = 51200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.443616 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.recheck_quota = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.444001 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.server_group_members = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.444398 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] quota.server_groups = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.444812 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rdp.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.445495 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.445865 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.446273 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.446660 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.image_metadata_prefilter = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.447047 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.447439 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.max_attempts = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.447829 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.max_placement_results = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.448214 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.448622 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.query_placement_for_availability_zone = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.449026 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.449412 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.449811 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] scheduler.workers = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.450251 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.450654 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.451179 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.451489 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.451894 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.452288 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.452703 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.453157 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.453554 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.host_subset_size = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.454017 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.454559 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.454756 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.isolated_hosts = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.455148 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.isolated_images = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.455605 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.455934 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.456320 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.456731 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.457131 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.457517 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.457897 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.458289 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.458706 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.track_instance_changes = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.459112 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.459501 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metrics.required = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.459881 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metrics.weight_multiplier = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.460269 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.460684 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] metrics.weight_setting = [] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.461311 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.461644 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.462102 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.port_range = 10000:20000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.462465 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.462858 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.463245 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] serial_console.serialproxy_port = 6083 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.463639 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.464045 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.auth_type = password {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.464419 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.464824 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.465230 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.465577 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.465952 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.466347 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.send_service_user_token = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.466727 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.467100 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] service_user.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.467499 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.agent_enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.467881 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.468529 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.468971 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.469362 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.html5proxy_port = 6082 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.470108 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.server_listen = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.470526 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.470921 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] upgrade_levels.baseapi = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.471302 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] upgrade_levels.cert = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.471725 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] upgrade_levels.compute = auto {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.472105 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] upgrade_levels.conductor = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.472530 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] upgrade_levels.scheduler = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.472943 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.473350 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.473728 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.cafile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.474103 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.certfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.474488 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.474903 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.475246 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.475627 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.476002 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vendordata_dynamic_auth.timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.476477 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.api_retry_count = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.476853 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.477227 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.cache_prefix = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.477610 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.cluster_name = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.477997 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.connection_pool_size = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.478392 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.console_delay_seconds = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.478744 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.datastore_regex = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.479135 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.host_ip = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.479512 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.host_password = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.479898 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.host_port = 443 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.480272 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.host_username = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.480687 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.insecure = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.481062 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.integration_bridge = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.481450 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.maximum_objects = 100 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.481824 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.pbm_default_policy = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.482207 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.pbm_enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.482586 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.pbm_wsdl_location = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.482980 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.483359 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.serial_port_proxy_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.483779 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.serial_port_service_uri = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.484159 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.task_poll_interval = 0.5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.484573 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.use_linked_clone = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.484997 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.vnc_keymap = en-us {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.486471 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.vnc_port = 5900 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.486621 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vmware.vnc_port_total = 10000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.487004 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.auth_schemes = ['none'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.487392 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.enabled = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.487983 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.488387 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.488805 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.novncproxy_port = 6080 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.489228 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.server_listen = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.489644 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.490044 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.vencrypt_ca_certs = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.490440 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.vencrypt_client_cert = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.490789 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] vnc.vencrypt_client_key = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.491201 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.491630 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.492017 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.492397 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.disable_native_luksv1 = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.492803 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.disable_rootwrap = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.493193 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.enable_numa_live_migration = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.493575 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.493955 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.494335 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.494738 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.rbd_volume_local_attach = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.495127 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.495556 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.495948 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.client_socket_timeout = 900 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.496576 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.default_pool_size = 1000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.496743 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.keep_alive = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.497131 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.max_header_line = 16384 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.497511 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.secure_proxy_ssl_header = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.497888 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.ssl_ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.498270 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.ssl_cert_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.498649 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.ssl_key_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.499031 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.tcp_keepidle = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.499436 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.499820 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] zvm.ca_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.500196 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] zvm.cloud_connector_url = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.500818 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.501377 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] zvm.reachable_timeout = 300 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.501671 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.enforce_new_defaults = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.502035 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.enforce_scope = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.502443 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.policy_default_rule = default {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.502872 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.503296 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.policy_file = policy.yaml {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.503733 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.504112 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.504539 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.504938 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.505319 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.505734 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.506180 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.connection_string = messaging:// {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.506608 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.enabled = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.506989 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.es_doc_type = notification {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.507377 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.es_scroll_size = 10000 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.507765 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.es_scroll_time = 2m {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.508148 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.filter_error_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.508561 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.hmac_keys = SECRET_KEY {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.508957 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.sentinel_service_name = mymaster {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.509372 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.socket_timeout = 0.1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.509750 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] profiler.trace_sqlalchemy = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.510178 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.backend = sqlalchemy {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.510587 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.510974 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.connection_debug = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.511365 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.connection_parameters = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.511755 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.connection_recycle_time = 3600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.512625 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.connection_trace = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.512625 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.db_inc_retry_interval = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.512877 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.db_max_retries = 20 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.513274 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.db_max_retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.513654 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.db_retry_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.514042 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.max_overflow = 50 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.514422 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.max_pool_size = 5 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.514808 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.max_retries = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.515185 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.mysql_enable_ndb = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.515578 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.515960 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.pool_timeout = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.517328 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.retry_interval = 10 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.517610 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.slave_connection = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.517867 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.sqlite_synchronous = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.518993 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.use_db_reconnect = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.518993 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] database.use_tpool = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.519274 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] remote_debug.host = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.519485 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] remote_debug.port = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.519912 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.520307 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.520745 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.521140 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.521532 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.521932 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.522323 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.522734 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.523137 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.523528 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.523933 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.524329 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.524750 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.525139 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.525524 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.525938 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.526326 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.527015 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.527459 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.528072 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.528476 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.528922 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.ssl = False {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.529286 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.529691 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.530097 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.530505 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.530964 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.531352 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_notifications.retry = -1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.531799 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.532996 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.533579 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_reports.file_event_handler = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.533994 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.534397 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] oslo_reports.log_dir = None {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 03:19:15.534717 n-d-802225-1 nova-conductor[99120]: DEBUG oslo_service.service [None req-d772b61b-0e37-46cc-94d5-b722c9b5cec7 None None] ******************************************************************************** {{(pid=99120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 03:22:15.256343 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:22:15.296290 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:22:16.278872 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 50350. Jul 26 03:22:16.315886 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 50352. Jul 26 03:25:16.274217 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:25:16.312278 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:25:17.296367 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 50420. Jul 26 03:25:17.334024 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 50422. Jul 26 03:27:53.065160 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_db.sqlalchemy.engines [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Parent process 99120 forked (99991) with an open database connection, which is being discarded and recreated. {{(pid=99991) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 26 03:27:54.230517 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Took 1.15 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:27:54.316409 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.321367 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.342063 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_db.sqlalchemy.engines [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:27:54.578067 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.581482 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.583039 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.583585 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.635821 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_db.sqlalchemy.engines [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99991) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:27:54.703601 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Getting quotas for project 25256d3d9fdd408db3c5be042ce525a3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:27:54.732772 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Getting quotas for user 0fc5a24554ff463f931f0826a0b2c04f and project 25256d3d9fdd408db3c5be042ce525a3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:27:54.746507 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] [instance: 9ae01442-776c-4db4-8684-ef2f243dcb1f] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:27:54.747943 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.748411 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.761298 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] [instance: 9ae01442-776c-4db4-8684-ef2f243dcb1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:27:54.766090 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.766831 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.864680 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.865386 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.866363 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-521ffe68-dd32-4f47-8449-6fa2b3b85baa tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Acquired lock "compute-rpcapi-router" {{(pid=99991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 26 03:27:54.867803 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.868343 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.869093 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:54.869497 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:54.885685 n-d-802225-1 nova-conductor[99991]: INFO nova.compute.rpcapi [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 26 03:27:54.886971 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd7fefe-47a9-4899-bea6-b05e908bbc88 None None] Releasing lock "compute-rpcapi-router" {{(pid=99991) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 26 03:27:55.876743 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_db.sqlalchemy.engines [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Parent process 99120 forked (99992) with an open database connection, which is being discarded and recreated. {{(pid=99992) checkout /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:413}} Jul 26 03:27:56.619854 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Took 0.72 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:27:56.677591 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:56.681032 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:56.689143 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_db.sqlalchemy.engines [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:27:56.847798 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:56.855820 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:56.856986 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:56.857387 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:56.879641 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_db.sqlalchemy.engines [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99992) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 03:27:56.916986 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Getting quotas for project 9b2909c2d5804221945906633d1f67b8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:27:56.934466 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Getting quotas for user 394188a4650d444c87dea76e20d7cac9 and project 9b2909c2d5804221945906633d1f67b8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:27:56.958710 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] [instance: c4d87718-8235-4158-8186-5891504d08de] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:27:56.959691 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:56.960096 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:56.983615 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] [instance: c4d87718-8235-4158-8186-5891504d08de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:27:56.989451 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:56.989855 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:57.115042 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:57.115514 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:57.116092 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-15b0afe6-be3e-40c1-bdf3-c618a06fb468 tempest-AggregatesAdminTestJSON-381783076 tempest-AggregatesAdminTestJSON-381783076-project] Acquired lock "compute-rpcapi-router" {{(pid=99992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 26 03:27:57.117730 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:57.118600 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:57.120932 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:27:57.122100 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:27:57.153471 n-d-802225-1 nova-conductor[99992]: INFO nova.compute.rpcapi [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 26 03:27:57.158495 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cfa3b81-d3a3-457c-860e-8cbf36ff1e9a None None] Releasing lock "compute-rpcapi-router" {{(pid=99992) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 26 03:28:30.181501 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Took 0.54 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:28:30.215327 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.216059 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:30.310447 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.312170 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:30.313785 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.315422 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:30.351323 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Getting quotas for project 3788ca4a811c40b7b6856e4321e69714. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:28:30.361996 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Getting quotas for user e1d7d1e9896a42aebd8de1118c1b197a and project 3788ca4a811c40b7b6856e4321e69714. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:28:30.385139 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] [instance: 0c0339f3-c0d3-4ec9-930b-61809ab3a1d6] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:28:30.386076 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.386474 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:30.400029 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] [instance: 0c0339f3-c0d3-4ec9-930b-61809ab3a1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:28:30.404327 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.405601 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:30.463793 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:30.464822 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-14cd7ca0-a54c-444b-83cb-ab44060edbb3 tempest-ServerDiagnosticsNegativeTest-631850056 tempest-ServerDiagnosticsNegativeTest-631850056-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:32.702161 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:28:32.742707 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:32.743114 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:32.833983 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:32.837249 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:32.838081 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:32.838574 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:32.874407 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Getting quotas for project 1f39abedcc4a4cc58a709648322983e2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:28:32.903481 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Getting quotas for user e4b73da26ef14cbe8d7bd5e1c86709da and project 1f39abedcc4a4cc58a709648322983e2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:28:32.929058 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] [instance: cf4a70d5-14b6-46c2-a58d-e23da143a7b4] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:28:32.930482 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:32.931091 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:32.942275 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] [instance: cf4a70d5-14b6-46c2-a58d-e23da143a7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:28:32.943831 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:32.945200 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:33.011662 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:33.012094 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e7aff124-30b1-4d94-ad7f-ee3388b6136a tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.602321 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:28:35.643761 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.644168 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.718709 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.720118 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.721347 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.722416 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.739271 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Getting quotas for project 25256d3d9fdd408db3c5be042ce525a3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:28:35.743153 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Getting quotas for user 0fc5a24554ff463f931f0826a0b2c04f and project 25256d3d9fdd408db3c5be042ce525a3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:28:35.754848 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] [instance: abfdbc8f-f44e-4ceb-bbb6-537e1738e645] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:28:35.756054 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.756890 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.772875 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] [instance: abfdbc8f-f44e-4ceb-bbb6-537e1738e645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:28:35.777756 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.778369 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:35.824576 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:35.824979 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-659641b0-012a-4222-a603-056186664747 tempest-DeleteServersAdminTestJSON-1503844862 tempest-DeleteServersAdminTestJSON-1503844862-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:53.831381 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:28:53.883097 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:53.883521 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:54.036179 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:54.039973 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:54.045894 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:54.047919 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:54.083445 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:28:54.103832 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for user 821a1a6e1ab34af2b49912230657ef57 and project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:28:54.121905 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 21e76c04-d449-4974-8605-7fb2a0ceaf83] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:28:54.123941 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:54.124348 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:54.143052 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 21e76c04-d449-4974-8605-7fb2a0ceaf83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:28:54.150507 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:54.151346 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:54.224858 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:54.225594 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-621937bc-4f60-44a0-9260-ece453caa8c3 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.371043 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:28:56.425267 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.425671 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.592921 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.599308 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.601127 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.613414 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.689068 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Getting quotas for project eea891bee3bc40b2a579cb8b09736e50. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:28:56.696007 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Getting quotas for user e9d49a4c3b5b466a98ffc1ca37dffb55 and project eea891bee3bc40b2a579cb8b09736e50. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:28:56.726224 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] [instance: 1aeddd36-48cd-47fa-9440-3608815c7543] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:28:56.728414 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.729626 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.747702 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] [instance: 1aeddd36-48cd-47fa-9440-3608815c7543] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:28:56.750475 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.751043 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:28:56.803886 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:28:56.804666 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5bbfc00e-10ae-408a-aba8-3986bf7636b8 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715 tempest-FloatingIPsAssociationNegativeTestJSON-1353478715-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.024014 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:01.067651 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.068535 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.194091 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.194517 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.195199 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.195588 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.236502 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:01.245153 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for user 03370ab9f4004c81b7eaf9aef8d240bd and project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:01.260480 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 6eb5538d-737c-4f8c-b472-d00cb34cde33] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:01.261768 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.262571 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.275975 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 6eb5538d-737c-4f8c-b472-d00cb34cde33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:01.277859 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.278454 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:01.335617 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:01.336507 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-42b3a1ab-dac2-4510-abf3-d9c69ac8f452 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.327811 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:03.376034 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.376469 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.512355 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.514663 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.521234 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.521813 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.542494 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Getting quotas for project 52d2aac62d0c48378e4a05c3bf787523. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:03.546758 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Getting quotas for user 22d665507f104348932b5bce78ab93b1 and project 52d2aac62d0c48378e4a05c3bf787523. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:03.585613 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] [instance: 0c97eddf-1391-4a3e-966e-40a725f8dfe1] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:03.586454 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.587029 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.603311 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] [instance: 0c97eddf-1391-4a3e-966e-40a725f8dfe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:03.604670 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.605816 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:03.708793 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:03.709258 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a819300-d9df-460b-9ae1-522cc3e32fe0 tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.701642 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:07.739896 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.740317 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.817945 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.818461 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.819597 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.820139 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.842843 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Getting quotas for project e6bb27bf448f42ebac2bdde3582d6f94. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:07.847163 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Getting quotas for user 2c536ac36e6b41d588beea983f539984 and project e6bb27bf448f42ebac2bdde3582d6f94. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:07.861471 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] [instance: 1c39e971-6f66-4487-b86b-9ec935a70d06] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:07.863317 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.863834 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.884893 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] [instance: 1c39e971-6f66-4487-b86b-9ec935a70d06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:07.891462 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.893727 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:07.949130 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:07.949784 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8836739a-5836-4544-9536-75c745fe7d96 tempest-VolumesAdminNegativeTest-1950240513 tempest-VolumesAdminNegativeTest-1950240513-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:12.113254 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:29:12.114050 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:12.114601 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:12.633079 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Created allocations for migration d38d1a85-8d12-40bd-bc2a-62100ab46db4 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:29:12.814734 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.utils [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 21e76c04-d449-4974-8605-7fb2a0ceaf83] Instance allocations successfully created on destination node 89921da4-8192-4609-a428-d99fff8e0658: {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99991) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:29:12.815185 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'resources' on Instance uuid 21e76c04-d449-4974-8605-7fb2a0ceaf83 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:12.822034 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'pci_requests' on Instance uuid 21e76c04-d449-4974-8605-7fb2a0ceaf83 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:13.357957 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.live_migrate [None req-da5e7f08-b6df-4aee-9764-0b3bd3a2a115 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 21e76c04-d449-4974-8605-7fb2a0ceaf83] Start binding ports on destination host: n-h2-802225-1 {{(pid=99991) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:29:21.686071 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:29:21.686771 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:21.687345 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:22.696879 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: 6eb5538d-737c-4f8c-b472-d00cb34cde33] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 03:29:23.962237 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Created allocations for migration 0b2282c3-bd75-41b1-97b2-620d354cd337 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:29:24.472124 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: 6eb5538d-737c-4f8c-b472-d00cb34cde33] Calling prep_resize with selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 03:29:24.911729 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Overwriting current allocation {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 23}}, 'project_id': 'f8c79845781f428a93244060c0b538a6', 'user_id': '03370ab9f4004c81b7eaf9aef8d240bd', 'consumer_generation': 1} on consumer 6eb5538d-737c-4f8c-b472-d00cb34cde33 {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 03:29:25.010481 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Created allocations for instance 6eb5538d-737c-4f8c-b472-d00cb34cde33 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 03:29:25.138339 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:29:25.140509 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: 6eb5538d-737c-4f8c-b472-d00cb34cde33] Setting instance to ACTIVE state. Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-1bfaf3d9-dfd7-4ce0-8b99-319242c3e486 tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 03:29:25.395489 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 03:29:25.396364 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 03:29:25.397639 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:29:25.397639 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 03:29:27.072749 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:27.105393 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.106176 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:27.209633 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.210070 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:27.211974 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.213779 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:27.263389 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Getting quotas for project 52d2aac62d0c48378e4a05c3bf787523. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:27.273441 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Getting quotas for user 22d665507f104348932b5bce78ab93b1 and project 52d2aac62d0c48378e4a05c3bf787523. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:27.300096 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] [instance: 1b677387-b439-4187-a1c1-0c35580c8828] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:27.301531 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.302583 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:27.320067 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] [instance: 1b677387-b439-4187-a1c1-0c35580c8828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:27.322559 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.323192 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:27.390123 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:27.390543 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5a84dade-c1c6-4335-bf6c-3ce78f21bf6c tempest-FloatingIPsAssociationTestJSON-1951733700 tempest-FloatingIPsAssociationTestJSON-1951733700-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:29.917702 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:29.950638 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:29.952711 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:30.069100 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:30.069506 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:30.070224 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:30.070609 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:30.116250 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:30.123102 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for user 821a1a6e1ab34af2b49912230657ef57 and project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:30.138518 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 07ce75af-19cb-479f-96bc-7bd16831f5e3] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:30.139778 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:30.141240 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:30.150389 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 07ce75af-19cb-479f-96bc-7bd16831f5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:30.152492 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:30.153295 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:30.206713 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:30.207693 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-684fe8d4-147d-4a76-bd01-975b30b9bfc4 tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:34.799375 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:34.818573 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:34.819226 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:34.899517 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:34.899872 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:34.900858 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:34.901398 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:34.923473 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:34.930985 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for user 2f26d7e0e83f41f7a75f571111e90c8a and project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:34.947340 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 96b63532-c05d-4342-8c78-7e84a67a7834] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:34.948882 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:34.953384 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:34.978295 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 96b63532-c05d-4342-8c78-7e84a67a7834] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:34.980038 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:34.980038 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:35.015351 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:35.015907 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fc7ebd2e-f0b0-4254-9de3-f213716dc2c7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.169651 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:45.193075 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.193581 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.257061 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.257778 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.258723 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.259374 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.279164 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:45.295974 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for user d6d29060adc947488bd259b2772e5670 and project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:45.309556 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: 32e8a424-fb99-4d0c-8cc5-e6292ad49314] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:45.310856 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.311557 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.322164 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: 32e8a424-fb99-4d0c-8cc5-e6292ad49314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:45.324393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.324988 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:45.376745 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:45.377360 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-76d1504f-4adf-4659-baab-c962cd58cd5f tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.605613 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:29:50.606496 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.606496 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.625604 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:50.653290 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.654130 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.722293 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.722696 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.723821 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.724208 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.743748 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:50.751075 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for user 2b1ed297c23f4fe5a851799db111a3d0 and project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:50.765939 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 09285c51-2f1e-43bf-87c2-360735fa21f1] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:50.767073 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.767622 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.783027 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 09285c51-2f1e-43bf-87c2-360735fa21f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:50.785378 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.785939 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:50.827235 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:50.827798 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e791fa6c-51c3-4907-8b7b-71390a148865 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:51.175905 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Created allocations for migration 88221619-e0b2-4cd6-84fd-889684ecb0a1 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:29:51.309784 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.utils [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 07ce75af-19cb-479f-96bc-7bd16831f5e3] Instance allocations successfully created on destination node c88f8435-9d4d-41fb-83fa-eae02604b075: {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99992) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:29:51.310336 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'resources' on Instance uuid 07ce75af-19cb-479f-96bc-7bd16831f5e3 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:51.320068 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'pci_requests' on Instance uuid 07ce75af-19cb-479f-96bc-7bd16831f5e3 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:51.910900 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-c93157a1-5b54-428c-ac1d-bdd4b3fdfb8b tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 07ce75af-19cb-479f-96bc-7bd16831f5e3] Start binding ports on destination host: n-h1-802225-1 {{(pid=99992) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:29:54.676336 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:29:54.723765 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.729561 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:54.812729 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.813280 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:54.814331 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.814852 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:54.832785 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:29:54.838278 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for user 2b1ed297c23f4fe5a851799db111a3d0 and project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:29:54.855496 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: ed388cd8-7281-45de-891b-b0f8abff1fe3] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:29:54.856804 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.857384 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:54.876487 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: ed388cd8-7281-45de-891b-b0f8abff1fe3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:29:54.878210 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.878765 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:54.961108 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:54.961604 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8d2d638-ea1d-4f03-a053-41db830a5ca4 tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:58.441820 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:29:58.443240 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:29:58.443969 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:29:58.877967 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Created allocations for migration fc8aa69d-5145-4c79-9599-ba74fbc7ea82 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:29:59.062261 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.utils [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 96b63532-c05d-4342-8c78-7e84a67a7834] Instance allocations successfully created on destination node c88f8435-9d4d-41fb-83fa-eae02604b075: {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99992) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:29:59.063303 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'resources' on Instance uuid 96b63532-c05d-4342-8c78-7e84a67a7834 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:59.069957 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'pci_requests' on Instance uuid 96b63532-c05d-4342-8c78-7e84a67a7834 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:29:59.369791 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-ed1e8a77-f5fd-4121-8bed-f32f5e2fba5c tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 96b63532-c05d-4342-8c78-7e84a67a7834] Start binding ports on destination host: n-h1-802225-1 {{(pid=99992) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:30:07.509824 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:07.552221 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.552844 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:07.669933 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.670344 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:07.671070 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.671466 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:07.697599 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:07.703285 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for user 821a1a6e1ab34af2b49912230657ef57 and project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:07.718353 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 6f207de3-09c2-4060-afe0-41f9cd249658] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:07.719966 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.720652 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:07.732146 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 6f207de3-09c2-4060-afe0-41f9cd249658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:07.733918 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.734555 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:07.785468 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:07.787396 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e534eab7-900e-4bf0-b23f-bca0436ae11f tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.305390 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:12.328905 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.329552 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.384686 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.385231 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.386338 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.386903 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.413422 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:12.418980 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for user 2f26d7e0e83f41f7a75f571111e90c8a and project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:12.434395 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: f96682d9-259c-4bb2-8c37-aa4f54e052e3] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:12.435335 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.435738 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.445142 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: f96682d9-259c-4bb2-8c37-aa4f54e052e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:12.446376 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.446777 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:12.478632 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:12.479236 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a09ea294-5c95-4a22-8084-775cdf178a3b tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.085411 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:13.136107 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.136201 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.210605 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.213077 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.214866 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.216104 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.236525 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Getting quotas for project 32cbfb1ab88a431db4c25ff931cc546a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:13.241113 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Getting quotas for user 24ab033446d14daf93d7a6bbd11d5716 and project 32cbfb1ab88a431db4c25ff931cc546a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:13.255682 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] [instance: 7524812b-0726-467a-9757-ade1e43e5d41] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:13.257030 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.257597 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.268762 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] [instance: 7524812b-0726-467a-9757-ade1e43e5d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:13.270806 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.271426 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.315790 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.316946 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5c428d17-7112-4066-8d59-94be412f9482 tempest-ImagesNegativeTestJSON-1287905224 tempest-ImagesNegativeTestJSON-1287905224-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.433001 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:13.471230 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.472210 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.583867 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.584285 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.585039 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.590171 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.620076 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:13.624641 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Getting quotas for user 2b1ed297c23f4fe5a851799db111a3d0 and project 4f11943e844f42e1a0a6341781b56814. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:13.637613 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 6f4f79f9-debb-489e-82dd-5c8c061e403a] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:13.638720 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.639146 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.649373 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 6f4f79f9-debb-489e-82dd-5c8c061e403a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:13.652280 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.653197 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:13.709189 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:13.710695 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2362e6aa-033b-4478-aeea-0377aa87dd0d tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:25.891193 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:25.936659 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:25.939100 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:26.075192 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:26.075880 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:26.076860 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:26.077414 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:26.095038 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:26.099500 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for user d6d29060adc947488bd259b2772e5670 and project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:26.111093 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: 66ec2419-ce09-42f1-af5d-b8132ad83d03] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:26.112195 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:26.112635 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:26.121205 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: 66ec2419-ce09-42f1-af5d-b8132ad83d03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:26.122691 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:26.123132 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:26.174238 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:26.174791 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0eda72fc-7894-401e-b0e0-c374d0e3d8de tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.827354 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:32.849525 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.850184 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.907378 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.907793 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.908734 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.909135 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.924854 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Getting quotas for project 1f39abedcc4a4cc58a709648322983e2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:32.928663 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Getting quotas for user e4b73da26ef14cbe8d7bd5e1c86709da and project 1f39abedcc4a4cc58a709648322983e2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:32.940863 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] [instance: f86b0680-134b-4dee-aee8-f3cded20dfd7] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:32.941848 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.942452 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.959871 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] [instance: f86b0680-134b-4dee-aee8-f3cded20dfd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:32.962457 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.963175 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:32.972317 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:32.973058 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:33.008145 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-85b7755c-b987-4906-8430-19f7de9b0c6a tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:30:33.013592 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85b7755c-b987-4906-8430-19f7de9b0c6a tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:33.014392 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85b7755c-b987-4906-8430-19f7de9b0c6a tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:33.014514 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:33.015184 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-647a68e4-4753-45f5-b02f-cb54c52b8e33 tempest-ServersWithSpecificFlavorTestJSON-1822779103 tempest-ServersWithSpecificFlavorTestJSON-1822779103-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:33.042650 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-85b7755c-b987-4906-8430-19f7de9b0c6a tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 09285c51-2f1e-43bf-87c2-360735fa21f1] No migration record for the rebuild/evacuate request. {{(pid=99991) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:30:33.349179 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:30:33.349671 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:33.350382 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:33.764711 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Created allocations for migration 2ef90b4c-fe63-4af4-9546-37a93e5e6630 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:30:33.949599 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.utils [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: f96682d9-259c-4bb2-8c37-aa4f54e052e3] Instance allocations successfully created on destination node c88f8435-9d4d-41fb-83fa-eae02604b075: {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99992) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:30:33.951587 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'resources' on Instance uuid f96682d9-259c-4bb2-8c37-aa4f54e052e3 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:30:33.956695 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'pci_requests' on Instance uuid f96682d9-259c-4bb2-8c37-aa4f54e052e3 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:30:34.289950 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-61fb78c8-66fc-4f8c-807c-17795429a606 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: f96682d9-259c-4bb2-8c37-aa4f54e052e3] Start binding ports on destination host: n-h1-802225-1 {{(pid=99992) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:30:39.372029 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:30:39.375088 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:39.375686 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:39.790028 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Created allocations for migration 61077c7a-9c48-401b-b0f4-d56883b501de on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:30:39.908025 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.utils [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 6f207de3-09c2-4060-afe0-41f9cd249658] Instance allocations successfully created on destination node 89921da4-8192-4609-a428-d99fff8e0658: {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99991) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:30:39.908470 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'resources' on Instance uuid 6f207de3-09c2-4060-afe0-41f9cd249658 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:30:39.915834 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6f207de3-09c2-4060-afe0-41f9cd249658 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:30:40.278294 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.live_migrate [None req-aa36eb5d-7529-4d4f-a5fc-537f9f7f0287 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 6f207de3-09c2-4060-afe0-41f9cd249658] Start binding ports on destination host: n-h2-802225-1 {{(pid=99991) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:30:44.273606 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:44.318639 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.319050 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:44.401849 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.402595 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:44.403440 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.403940 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:44.426476 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:44.432087 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for user 2f26d7e0e83f41f7a75f571111e90c8a and project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:44.452551 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 054e8f16-716f-47d7-a4b9-656a76469613] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:44.452551 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.452551 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:44.464346 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 054e8f16-716f-47d7-a4b9-656a76469613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:44.471210 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.472202 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:44.534206 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:44.534886 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-738cc911-518b-43a4-bd86-82a71cdc9b2c tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.123916 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Took 0.59 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:30:54.158365 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.158850 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.235320 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.235837 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.236700 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.237508 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.265783 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:30:54.271848 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Getting quotas for user d6d29060adc947488bd259b2772e5670 and project 87ff0c735d1340368798aa17dfb8c897. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:30:54.288696 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: d8d7ad34-0e62-4e5d-87f2-24a09effd9fa] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:30:54.290356 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.291457 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.303428 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] [instance: d8d7ad34-0e62-4e5d-87f2-24a09effd9fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:30:54.307987 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.309264 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:54.390323 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:54.390323 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1a65f0bf-aed9-4e6c-af4c-205299ed746a tempest-ImagesOneServerNegativeTestJSON-30722878 tempest-ImagesOneServerNegativeTestJSON-30722878-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:55.089350 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-351d0715-b555-441d-9f07-85371af2a17c tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:30:55.089875 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-351d0715-b555-441d-9f07-85371af2a17c tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:30:55.094260 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-351d0715-b555-441d-9f07-85371af2a17c tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:30:55.129882 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-351d0715-b555-441d-9f07-85371af2a17c tempest-ServersAdminTestJSON-1156213779 tempest-ServersAdminTestJSON-1156213779-project] [instance: 09285c51-2f1e-43bf-87c2-360735fa21f1] No migration record for the rebuild/evacuate request. {{(pid=99992) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:31:09.469007 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:09.511058 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.512184 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:09.596741 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.598051 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:09.599203 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.599870 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:09.620896 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Getting quotas for project 0d66db4a7677442a8e733e05db8ff020. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:09.626464 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Getting quotas for user 89b23a4e2893421a81f44b784ccefad3 and project 0d66db4a7677442a8e733e05db8ff020. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:09.652009 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] [instance: 455bf836-72e7-4522-8f85-be2ae15004c3] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:09.653262 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.654921 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:09.698852 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] [instance: 455bf836-72e7-4522-8f85-be2ae15004c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:09.700343 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.702769 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:09.776586 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:09.777429 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-de71339d-3bf0-42af-adc8-62f8b85b6f02 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.041328 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:10.099370 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.108316 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.211034 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.211034 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.214257 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.214673 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.253815 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Getting quotas for project 62b86b6f810e478192ad365601fc0a23. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:10.257771 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Getting quotas for user a07359c1a1ae484a936417e446134699 and project 62b86b6f810e478192ad365601fc0a23. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:10.281360 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] [instance: 73a2a6cc-91bb-42e7-b876-52ededf878e2] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:10.283838 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.293058 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.302033 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] [instance: 73a2a6cc-91bb-42e7-b876-52ededf878e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:10.303922 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.304576 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:10.348355 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:10.349271 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b266fa30-4af5-45db-a501-5c5f032bc42a tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:26.711425 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:31:26.712315 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:26.713668 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:27.247354 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Created allocations for migration 421a7366-c319-4f7d-b58f-f4c209a8f8b7 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:31:27.406002 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.utils [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 054e8f16-716f-47d7-a4b9-656a76469613] Instance allocations successfully created on destination node c88f8435-9d4d-41fb-83fa-eae02604b075: {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}}}} {{(pid=99991) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:31:27.406598 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'resources' on Instance uuid 054e8f16-716f-47d7-a4b9-656a76469613 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:31:27.411848 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'pci_requests' on Instance uuid 054e8f16-716f-47d7-a4b9-656a76469613 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:31:27.732309 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.live_migrate [None req-e4b26fcf-201f-44dc-86f8-f634d97e49b8 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 054e8f16-716f-47d7-a4b9-656a76469613] Start binding ports on destination host: n-h1-802225-1 {{(pid=99991) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:31:36.527175 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:36.577901 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.578561 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:36.709672 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.710927 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:36.712903 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.713542 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:36.736194 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Getting quotas for project 8cdf3298427543529c2307f35be49993. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:36.740305 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Getting quotas for user b851a985dbed4ec8901ef52f3b5e0214 and project 8cdf3298427543529c2307f35be49993. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:36.755128 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] [instance: ab99214f-be46-49f6-90d3-a7721c103138] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:36.756084 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.756509 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:36.767138 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] [instance: ab99214f-be46-49f6-90d3-a7721c103138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:36.769219 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.769673 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:36.824524 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:36.824975 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-47413f0e-4c54-4ef1-872a-e4dd3156ca66 tempest-ServersTestJSON-1355975421 tempest-ServersTestJSON-1355975421-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.323533 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:40.346407 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.346819 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.426428 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.427896 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.432585 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.433825 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.453288 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:40.457879 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Getting quotas for user 821a1a6e1ab34af2b49912230657ef57 and project ab5035f44f114887a80f2e2ffa4dbcf8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:40.470819 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 55b8e0fd-6356-453a-b132-227332c2ecca] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:40.472394 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.473070 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.484485 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] [instance: 55b8e0fd-6356-453a-b132-227332c2ecca] block_device_mapping [BlockDeviceMapping(attachment_id=f1d588b6-a7a3-407b-8ec9-98e2febc426e,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a467e775-1da6-4d90-8004-da0c799f7891',volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:40.496621 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.497399 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:40.557486 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:40.558161 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d9e3d6b4-089b-4144-a86e-1465f12c5e4c tempest-LiveAutoBlockMigrationV225Test-1996879800 tempest-LiveAutoBlockMigrationV225Test-1996879800-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.363028 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:51.402786 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.403428 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.517546 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.517948 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.522340 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.523768 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.594056 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Getting quotas for project 0d66db4a7677442a8e733e05db8ff020. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:51.604256 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Getting quotas for user 89b23a4e2893421a81f44b784ccefad3 and project 0d66db4a7677442a8e733e05db8ff020. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:51.662859 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] [instance: 308194de-bb5e-4317-812d-92dead3adbdf] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:51.667237 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.670393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.698385 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] [instance: 308194de-bb5e-4317-812d-92dead3adbdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:51.699890 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.700360 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:51.761545 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:51.761977 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b52b4617-df1b-45d7-863d-f25f62ca7e41 tempest-ServersTestMultiNic-1314210335 tempest-ServersTestMultiNic-1314210335-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.305494 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:31:54.373492 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.374328 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.476950 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.477368 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.478118 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.478503 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.500306 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Getting quotas for project 62b86b6f810e478192ad365601fc0a23. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:31:54.511699 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Getting quotas for user a07359c1a1ae484a936417e446134699 and project 62b86b6f810e478192ad365601fc0a23. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:31:54.526765 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] [instance: dadc24d8-ccc7-4436-8667-0389803864eb] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:31:54.527723 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.528132 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.537870 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] [instance: dadc24d8-ccc7-4436-8667-0389803864eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:31:54.540003 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.540493 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:31:54.579857 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:31:54.580698 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a5f28b5e-06c2-475c-a47d-1785b274c333 tempest-ServerRescueTestJSON-1306823489 tempest-ServerRescueTestJSON-1306823489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:01.201168 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:32:01.201715 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:01.208104 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:01.676850 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Created allocations for migration 3200a6c0-bdaa-44d3-af09-f1ff61c18f46 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:32:01.873249 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.utils [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 55b8e0fd-6356-453a-b132-227332c2ecca] Instance allocations successfully created on destination node 89921da4-8192-4609-a428-d99fff8e0658: {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99992) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:32:01.873683 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'resources' on Instance uuid 55b8e0fd-6356-453a-b132-227332c2ecca {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:32:01.878972 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] Lazy-loading 'pci_requests' on Instance uuid 55b8e0fd-6356-453a-b132-227332c2ecca {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:32:02.166350 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-11e5c902-0820-4196-94a9-5cdcfa6b88d2 tempest-LiveAutoBlockMigrationV225Test-358459106 tempest-LiveAutoBlockMigrationV225Test-358459106-project-admin] [instance: 55b8e0fd-6356-453a-b132-227332c2ecca] Start binding ports on destination host: n-h2-802225-1 {{(pid=99992) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:32:25.105231 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:32:25.160106 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.161901 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:25.259387 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.260134 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:25.263250 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.263913 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:25.290164 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:32:25.309352 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Getting quotas for user 2f26d7e0e83f41f7a75f571111e90c8a and project 89d9dadac15c4def98f1b864b7760996. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:32:25.350348 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 6b1c08c0-1abd-4b50-9268-14d090f8bb5e] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:32:25.351680 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.352795 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:25.363203 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] [instance: 6b1c08c0-1abd-4b50-9268-14d090f8bb5e] block_device_mapping [BlockDeviceMapping(attachment_id=0a342ac9-0a47-4b2b-8003-b8cc0a8013e6,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0751cfb-75ad-4d4c-bb50-c4e4efa208c2',volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:32:25.366182 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.366793 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:25.407085 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:25.408714 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2012420d-b623-4a63-b895-5375eeed6ea7 tempest-LiveMigrationTest-303608204 tempest-LiveMigrationTest-303608204-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:42.543128 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Took 0.53 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:32:42.585174 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:42.585586 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:42.767034 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:42.767723 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:42.777433 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:42.781186 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:42.861604 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Getting quotas for project 03c5f8032eea4d4c87f17bd30260f8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:32:42.890071 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Getting quotas for user abcefffcb4ca4ca7bd68dae2807fb1d2 and project 03c5f8032eea4d4c87f17bd30260f8ff. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:32:42.928585 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] [instance: bb3cdf45-d78d-4028-b94a-418dc78ce3cd] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:32:42.933396 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:42.933980 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:42.959892 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] [instance: bb3cdf45-d78d-4028-b94a-418dc78ce3cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:32:42.961500 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:42.962161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:43.031870 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:43.032426 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-91908118-68f0-423b-a6c9-07e365213e93 tempest-InstanceActionsTestJSON-1937943783 tempest-InstanceActionsTestJSON-1937943783-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:55.994485 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:32:55.997044 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:32:55.999216 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:32:56.572572 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Created allocations for migration e7d5730a-a148-4946-8012-240adb982f59 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:32:56.749040 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.utils [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 6b1c08c0-1abd-4b50-9268-14d090f8bb5e] Instance allocations successfully created on destination node c88f8435-9d4d-41fb-83fa-eae02604b075: {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024}}}} {{(pid=99991) claim_resources_on_destination /opt/stack/nova/nova/scheduler/utils.py:828}} Jul 26 03:32:56.749946 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'resources' on Instance uuid 6b1c08c0-1abd-4b50-9268-14d090f8bb5e {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:32:56.755683 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] Lazy-loading 'pci_requests' on Instance uuid 6b1c08c0-1abd-4b50-9268-14d090f8bb5e {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:32:57.121869 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.live_migrate [None req-5db39c27-a6f0-4207-b393-e95a538d3aa4 tempest-LiveMigrationTest-1360697045 tempest-LiveMigrationTest-1360697045-project-admin] [instance: 6b1c08c0-1abd-4b50-9268-14d090f8bb5e] Start binding ports on destination host: n-h1-802225-1 {{(pid=99991) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 03:33:00.235172 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Took 0.57 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:00.258349 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.258944 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:00.338269 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.339043 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:00.340121 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.340815 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:00.401918 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Getting quotas for project 476a025fd7da412f94660ff61bd4c3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:00.423151 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Getting quotas for user c0dc43c50de94f1993c44068849932ba and project 476a025fd7da412f94660ff61bd4c3dd. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:00.442486 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] [instance: 0c8d32c8-e86c-4c39-81f0-3ee0296ce2f8] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:00.443875 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.444313 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:00.472265 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] [instance: 0c8d32c8-e86c-4c39-81f0-3ee0296ce2f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5661ea25-b02e-44de-846b-6f6e9cdab819',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:00.474080 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.474496 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:00.522479 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:00.522947 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ad360793-0b67-4058-87c1-7ee92a5ca4a7 tempest-AttachSCSIVolumeTestJSON-336476622 tempest-AttachSCSIVolumeTestJSON-336476622-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.115152 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:14.140165 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.140876 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.201255 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.201666 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.202385 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.202772 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.221579 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Getting quotas for project 192637372ef948d69558ffd3d4a92c36. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:14.225260 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Getting quotas for user 10aa9618fa4549078da3c28fdde5be09 and project 192637372ef948d69558ffd3d4a92c36. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:14.239441 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] [instance: f1e458aa-ac5f-4ed6-97d7-3be3dadf226f] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:14.240623 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.241025 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.249345 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] [instance: f1e458aa-ac5f-4ed6-97d7-3be3dadf226f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:14.250394 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.250954 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.291299 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.294044 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-487cd8ed-7b86-4f78-acdd-eb987b042f38 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.817782 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:14.848321 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.849065 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.893896 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:14.939165 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.939586 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.973636 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.974069 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:14.974895 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:14.977272 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.026704 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:15.031156 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:15.044855 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 82c0a845-4a77-4471-bf23-ae8ec73d3c42] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:15.046168 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.046750 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.054218 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.054852 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.055834 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.056386 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.069914 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 82c0a845-4a77-4471-bf23-ae8ec73d3c42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:15.074391 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.075121 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.085525 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Getting quotas for project 088221f94c504adb89ab58a6154bb7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:15.094122 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Getting quotas for user 911de8a3ea064319825f4c35644c2348 and project 088221f94c504adb89ab58a6154bb7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:15.156284 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] [instance: e4e99957-21c9-47b1-af3b-90a919e0c353] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:15.158514 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.159585 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.173147 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.173957 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c4d3140f-b2fe-4b1d-9dda-a2bd27fae48c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.175139 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] [instance: e4e99957-21c9-47b1-af3b-90a919e0c353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:15.177455 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.178082 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:15.231143 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:15.231725 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3f346493-9fc5-43c0-95a6-95ce6c2acc88 tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.246497 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:16.291880 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.292775 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.380759 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.381541 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.382948 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.383548 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.407182 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Getting quotas for project 192637372ef948d69558ffd3d4a92c36. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:16.412126 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Getting quotas for user 10aa9618fa4549078da3c28fdde5be09 and project 192637372ef948d69558ffd3d4a92c36. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:16.424628 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] [instance: d57c97ac-c6a6-496c-9513-490ee8d08500] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:16.426102 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.426821 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.439615 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] [instance: d57c97ac-c6a6-496c-9513-490ee8d08500] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:16.442752 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.443402 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:16.492548 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:16.492958 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9eaceb5f-14e7-40ac-84dc-eb7c98d064c9 tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:21.138761 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-830680e4-6c30-4f22-83eb-5d2352cbc3df tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:33:21.139743 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-830680e4-6c30-4f22-83eb-5d2352cbc3df tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:21.140698 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-830680e4-6c30-4f22-83eb-5d2352cbc3df tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:21.172883 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-830680e4-6c30-4f22-83eb-5d2352cbc3df tempest-ServerShowV247Test-219663098 tempest-ServerShowV247Test-219663098-project] [instance: d57c97ac-c6a6-496c-9513-490ee8d08500] No migration record for the rebuild/evacuate request. {{(pid=99991) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:33:28.018603 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:28.038552 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.039056 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:28.090559 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.091013 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:28.091752 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.092154 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:28.111474 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Getting quotas for project c7f64bc83d8444498e27bc01b7e28736. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:28.115190 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Getting quotas for user 620f4fcc4040424a93dd3c78709ebe85 and project c7f64bc83d8444498e27bc01b7e28736. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:28.124841 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] [instance: 948083ea-ca9f-42d0-909b-0dcfb4f8cb0d] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:28.125803 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.126211 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:28.132822 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] [instance: 948083ea-ca9f-42d0-909b-0dcfb4f8cb0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:28.134001 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.134407 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:28.160583 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:28.160910 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6bc08869-ef9c-4127-9c1a-eac3491ea9b1 tempest-TenantUsagesTestJSON-251616351 tempest-TenantUsagesTestJSON-251616351-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.583858 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:30.604159 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.604732 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.667703 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.668156 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.669115 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.669515 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.689823 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Getting quotas for project 088221f94c504adb89ab58a6154bb7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:30.693519 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Getting quotas for user 911de8a3ea064319825f4c35644c2348 and project 088221f94c504adb89ab58a6154bb7b7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:30.704411 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] [instance: 104299ff-8b13-4880-87ed-dfb3e8b65a39] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:30.705413 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.706007 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.713408 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] [instance: 104299ff-8b13-4880-87ed-dfb3e8b65a39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:30.715286 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.715696 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:30.761305 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:30.761970 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-400e6555-d1b2-47ec-9b30-42d25a94d60e tempest-LiveMigrationNegativeTest-780757706 tempest-LiveMigrationNegativeTest-780757706-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:33.542078 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:33.562754 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: e41f4119-2a28-43e6-98e1-1ea5568a31a4] While scheduling instance, the build request was already deleted. {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1572}} Jul 26 03:33:33.712206 n-d-802225-1 nova-conductor[99992]: INFO nova.scheduler.client.report [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Deleted allocation for instance e41f4119-2a28-43e6-98e1-1ea5568a31a4 Jul 26 03:33:33.722439 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:33.723453 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:33.724730 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:33.725298 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:33.761596 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:33.768997 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0b4b52fd-88ff-4ef4-914c-778201591510 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:35.585075 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:35.617158 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.617571 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:35.725680 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.726411 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:35.727316 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.727890 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:35.746101 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:35.752401 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:35.764491 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 79de798f-5430-42c3-9078-a10568f06fca] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:35.770358 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.771150 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:35.781005 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 79de798f-5430-42c3-9078-a10568f06fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:35.782960 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.783603 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:35.875577 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:35.877385 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7676970a-405c-4b23-993e-c4d087612716 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:55.884689 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.42 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:33:55.928804 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:55.929531 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:56.022173 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:56.024561 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:56.025552 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:56.026125 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:56.056632 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:33:56.060733 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:33:56.072727 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: cdee62d2-3ec8-46ea-b326-408f982cb014] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:33:56.074308 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:56.074883 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:56.087359 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: cdee62d2-3ec8-46ea-b326-408f982cb014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:33:56.088898 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:56.089334 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:33:56.182468 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:33:56.188667 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-095c799b-4d9b-4e63-bd2a-840bacd96fab tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:11.669929 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:34:11.737205 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:11.740256 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:11.835877 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:11.836982 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:11.842035 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:11.843821 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:11.888707 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:34:11.895412 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:34:11.922197 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 2cddb83c-0d6a-4a74-9010-710094d8b38d] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:11.924152 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:11.924923 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:11.962027 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 2cddb83c-0d6a-4a74-9010-710094d8b38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:11.964018 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:11.964749 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:12.022230 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:12.022981 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-614ca806-48ee-416b-9434-71218649a291 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.619978 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:34:23.659452 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.663060 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.757564 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.759131 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.761149 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.765135 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.806455 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:34:23.812099 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:34:23.840650 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: f1a67362-c55d-47fb-9ec5-d6dbe91eaa5f] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:23.841657 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.842151 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.854603 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: f1a67362-c55d-47fb-9ec5-d6dbe91eaa5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:23.855944 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.856624 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:23.908210 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:23.909356 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4fa9de23-2a92-4050-ab32-72a0061113ec tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:32.280933 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:32.281486 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:32.962519 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.53 seconds to select destinations for 2 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:34:33.011703 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.023793 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.127143 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.130483 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.221407 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.222074 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.223679 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.226531 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.270923 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:34:33.283416 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:34:33.319218 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 722420fa-4f44-40ce-bbe3-b439d9e25dfd] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:33.320603 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.321168 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.329528 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 722420fa-4f44-40ce-bbe3-b439d9e25dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:33.332072 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.332706 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.410633 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.411144 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.429335 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 69d3968d-1e7e-49af-91d4-539d4d365cf0] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:33.430626 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance_group [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lazy-loading 'hosts' on InstanceGroup uuid 4578ed38-8b78-467a-aea3-efe24aa2ca3e {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jul 26 03:34:33.452376 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.456167 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.489317 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 69d3968d-1e7e-49af-91d4-539d4d365cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:33.492519 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.492989 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:33.576830 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:33.577496 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fccf60a3-f2b0-4f3b-81b3-292d673326cb tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.128435 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:34:42.187860 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.190440 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.289978 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.290637 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.292292 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.292954 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.317249 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:34:42.327077 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:34:42.369976 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: fcd539d4-454b-42a3-bd60-10861c57b281] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:42.371075 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.371484 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.382552 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: fcd539d4-454b-42a3-bd60-10861c57b281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:42.383830 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.384292 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:42.434444 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:42.434840 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c5775f9f-0714-4b7b-80ea-c54d078f731c tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:51.358170 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:34:52.396040 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33380. Jul 26 03:34:57.395302 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:57.395302 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.033614 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.57 seconds to select destinations for 2 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:34:58.081425 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.081425 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.174012 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.174422 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.270300 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.270906 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.271803 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.272422 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.291076 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:34:58.302636 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:34:58.321349 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: f69cfdb4-36cb-4e71-be81-4fbc84843ede] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:58.322563 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.323034 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.341601 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: f69cfdb4-36cb-4e71-be81-4fbc84843ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:58.343321 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.345452 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.392802 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.393482 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.416121 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 55abb340-3536-433e-97ce-892a6c2d6502] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:34:58.416757 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance_group [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lazy-loading 'hosts' on InstanceGroup uuid 15bb5506-857e-41ba-89ee-8d65055c9c4c {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance_group.py:357}} Jul 26 03:34:58.435415 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.435828 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.444952 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 55abb340-3536-433e-97ce-892a6c2d6502] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:34:58.447282 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.448196 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:34:58.507840 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:34:58.508255 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a8723e15-a36a-463c-ae66-fd05d0932f09 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.389993 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:00.420326 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.422269 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.515056 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.515299 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.516064 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.516484 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.536774 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:00.541735 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for user 9b9d915eeb614cbdbfc3fe95d98d5373 and project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:00.588137 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: a44fe354-c7b5-4b55-964d-a734d294fae2] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:00.592387 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.592837 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.601752 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: a44fe354-c7b5-4b55-964d-a734d294fae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:00.603497 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.604133 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:00.656545 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:00.657228 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6569da3a-e29b-4ce4-a06d-93c1fbc8bc97 tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.003548 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:03.039668 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.040293 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.136860 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.137589 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.138799 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.139908 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.166556 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Getting quotas for project 4ccdcdd412274d2f9d47e5934c4cff95. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:03.173133 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Getting quotas for user ea1fa5f3c3bf4833857f01d0357da338 and project 4ccdcdd412274d2f9d47e5934c4cff95. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:03.194823 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] [instance: a8056053-3df6-4c18-bb1a-e1408c71794c] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:03.196132 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.197548 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.212223 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] [instance: a8056053-3df6-4c18-bb1a-e1408c71794c] block_device_mapping [BlockDeviceMapping(attachment_id=e15815da-2382-43b4-8942-ebc5aedd7cf3,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='cb19da26-d9f7-4756-8214-dd86f4e7dc88',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=7355f658-a042-4769-aa96-3408ec93c6a7,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cacc72bc-54f8-4ac7-97af-89fd5ee4bcb2',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=986406d3-0c9e-4e67-b63b-0caf61421a15,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcd825e6-d36d-4199-bc53-53812c0c1024',volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:03.215923 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.216931 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.232021 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.233065 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.249166 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.250411 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:03.294986 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:03.295401 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-21537b32-11b5-44a5-82d8-d68dfef12639 tempest-TaggedBootDevicesTest_v242-908755573 tempest-TaggedBootDevicesTest_v242-908755573-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:12.856591 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:35:13.885806 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34086. Jul 26 03:35:21.119568 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:21.141883 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.142688 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:21.218466 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.219424 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:21.220434 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.221061 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:21.262449 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:21.271366 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:21.299391 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 1738ccaf-ecfb-4e93-b1da-63d9963db1ab] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:21.304684 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.305285 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:21.327274 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: 1738ccaf-ecfb-4e93-b1da-63d9963db1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:21.329910 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.330506 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:21.393502 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:21.394434 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-7fabeb3d-0938-40e9-9814-3c1e3e586993 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:25.750924 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:25.775811 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:25.776868 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:25.898309 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:25.898728 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:25.902688 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:25.904955 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:25.938111 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:25.943908 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:25.956545 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: ddcbb174-2ec0-466f-a9ab-b8ceecb40223] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:25.958451 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:25.959077 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:25.976723 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: ddcbb174-2ec0-466f-a9ab-b8ceecb40223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:25.979102 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:25.979975 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:26.025878 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:26.026558 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-836f243b-9af2-4c59-a9e6-703d5501bf68 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:28.868722 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Took 0.55 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:28.910232 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:28.910861 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:29.007792 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:29.010901 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:29.011912 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:29.015017 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:29.055699 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:29.069050 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for user 03370ab9f4004c81b7eaf9aef8d240bd and project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:29.099355 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: bed92eff-fc8d-4fdb-9cb6-f0a485095d8f] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:29.100053 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:29.100475 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:29.113251 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: bed92eff-fc8d-4fdb-9cb6-f0a485095d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:29.115878 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:29.116569 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:29.179605 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:29.180147 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e347a8b3-7a34-40ae-ae45-504f2f95d677 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.440742 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:50.500465 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.505258 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.685058 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.686325 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.691453 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.691989 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.751600 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:50.770061 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for user d92851b0840e4573970cfa9f0f7fcf81 and project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:50.815670 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: a8b22dd7-32d6-4b5e-a503-042ed2d28133] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:50.816725 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.817258 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.842756 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: a8b22dd7-32d6-4b5e-a503-042ed2d28133] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:50.844809 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.846030 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:50.936407 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:50.937101 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-efd445b2-cd09-4237-b0a1-fcf3862bc212 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:52.934134 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:52.972721 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:52.973903 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.015667 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:35:53.016926 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.018291 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.069484 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.069936 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.073501 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.073915 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.127213 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:53.136226 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for user d92851b0840e4573970cfa9f0f7fcf81 and project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:53.160340 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: 69db7f25-660c-4eaa-935f-e7a2c2647427] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:53.162086 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.162959 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.172432 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: 69db7f25-660c-4eaa-935f-e7a2c2647427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:53.174281 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.174846 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.237681 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:53.238449 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-43a14c77-1f1a-4d84-ba33-d21711016798 tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:53.462913 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: bed92eff-fc8d-4fdb-9cb6-f0a485095d8f] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99991) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 03:35:53.802658 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Created allocations for migration 52a71a5f-c9bc-4684-9ae5-1684289c0114 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:35:54.109176 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: bed92eff-fc8d-4fdb-9cb6-f0a485095d8f] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99991) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 03:35:54.368568 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.client.report [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 68}}, 'project_id': 'f8c79845781f428a93244060c0b538a6', 'user_id': '03370ab9f4004c81b7eaf9aef8d240bd', 'consumer_generation': 1} on consumer bed92eff-fc8d-4fdb-9cb6-f0a485095d8f {{(pid=99991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 03:35:54.543772 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Created allocations for instance bed92eff-fc8d-4fdb-9cb6-f0a485095d8f on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 03:35:54.737252 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:35:54.738957 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: bed92eff-fc8d-4fdb-9cb6-f0a485095d8f] Setting instance to ACTIVE state. Jul 26 03:35:54.886178 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:54.929132 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:54.929720 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server [None req-e7f95838-6208-4157-beeb-42f5678941b5 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 03:35:54.944837 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 03:35:54.946270 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 03:35:54.947702 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:35:54.947702 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Jul 26 03:35:55.036634 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.037394 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.038563 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.039119 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.060980 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:55.067890 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Getting quotas for user d92851b0840e4573970cfa9f0f7fcf81 and project 8f82bbae14e34d84924614966f7224a7. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:55.083441 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: 55ae48f0-e46d-4a5c-a759-1f799c00281e] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:55.085067 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.085639 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.095003 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] [instance: 55ae48f0-e46d-4a5c-a759-1f799c00281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:55.097053 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.097633 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.143077 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.143776 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2091aea1-11b4-47b7-a68f-de8e3f352f1f tempest-ListServerFiltersTestJSON-949649066 tempest-ListServerFiltersTestJSON-949649066-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.337477 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:55.365932 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.366643 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.460358 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.460878 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.462685 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.463528 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.503801 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Getting quotas for project 0e85a07488e04174945118fb41340b7e. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:55.508397 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Getting quotas for user fc193e1decd14ae8a8b54433824b6248 and project 0e85a07488e04174945118fb41340b7e. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:55.521775 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] [instance: 59f29e5f-c517-48d6-891a-d3b76a62e71d] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:55.522883 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.523645 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.532382 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] [instance: 59f29e5f-c517-48d6-891a-d3b76a62e71d] block_device_mapping [BlockDeviceMapping(attachment_id=13c4ba55-b004-4282-8726-cd4897131992,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ea7c350-2935-4c7d-a7b4-013943e00a6c',volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:55.534135 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.534545 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.567465 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.567982 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-84194fa8-b6a0-4137-af7f-ac4cb83373bb tempest-ServersTestBootFromVolume-185334669 tempest-ServersTestBootFromVolume-185334669-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:55.925712 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:55.987654 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:55.991932 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:56.151601 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:56.155049 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:56.156667 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:56.163596 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:56.199126 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:56.211001 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Getting quotas for user 128dab8e43214bdc92549cbb785e1cf0 and project 95b057f5cba54ba58e968a9258847a78. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:56.241874 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: bafb2a45-3379-4827-80d8-eda795cc291e] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:56.245694 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:56.246422 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:56.266934 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] [instance: bafb2a45-3379-4827-80d8-eda795cc291e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:56.268876 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:56.269672 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:56.332835 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:56.334007 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b74a02c2-829d-4b5e-af47-58fc1c63f561 tempest-ServersTestJSON-880246576 tempest-ServersTestJSON-880246576-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.479075 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:35:57.523745 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.524157 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.614125 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.616295 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.618565 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.618979 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.670234 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:35:57.695519 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:35:57.731484 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 4f8a4d9b-a67b-41ea-8feb-306c07f5a650] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:35:57.733135 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.733482 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.762502 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: 4f8a4d9b-a67b-41ea-8feb-306c07f5a650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:35:57.763981 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.764567 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:35:57.829056 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:35:57.829472 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7d650098-d6e4-43f7-b571-a964c705446f tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:03.773325 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:36:03.807036 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:03.807365 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:03.915222 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:03.920019 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:03.921217 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:03.921217 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:03.958099 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:36:03.972396 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for user 9b9d915eeb614cbdbfc3fe95d98d5373 and project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:36:03.991868 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 8a38c9ad-96ed-4f1c-9a24-b587580b613b] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:36:03.992866 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:03.994913 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:04.013173 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 8a38c9ad-96ed-4f1c-9a24-b587580b613b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:36:04.015737 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:04.016183 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:04.075099 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:04.075557 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-54e54016-77e7-41da-8e12-71cdbaee38dc tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:05.315510 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:36:19.834708 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:36:19.857565 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:19.858456 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:19.923238 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:19.924497 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:19.925821 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:19.926221 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:19.945864 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:36:19.951968 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Getting quotas for user 34da39ac88df42bf8309a86d3c5a5ba4 and project 9d2ac47389414d988e69ce262c0a337b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:36:19.969586 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: f3568d79-f61a-43db-988a-01e6fd0e6e47] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:36:19.971474 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:19.972067 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:19.990632 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] [instance: f3568d79-f61a-43db-988a-01e6fd0e6e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:36:19.992576 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:19.993263 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:36:20.063216 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:36:20.063458 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-9e2e6209-a802-4d76-9120-ecf0704df6c7 tempest-ServersOnMultiNodesTest-1793607307 tempest-ServersOnMultiNodesTest-1793607307-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.554688 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Took 0.52 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:37:15.641980 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.642566 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.773139 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.773832 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.774765 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.775332 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.805745 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Getting quotas for project 198d515eeeff46ae91250bb0254342fe. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:37:15.812583 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Getting quotas for user 72777c2a06a1428d8ddbf53d5433198d and project 198d515eeeff46ae91250bb0254342fe. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:37:15.826284 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] [instance: 3b5712f1-b614-4403-9cec-29d973a4489f] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:37:15.827600 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.828273 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.842363 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] [instance: 3b5712f1-b614-4403-9cec-29d973a4489f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:37:15.845872 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.848191 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:15.906693 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:37:15.930600 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:15.931567 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-cfcff18f-f410-4c0b-b381-47ce583f1c05 tempest-ServerAddressesNegativeTestJSON-1154083596 tempest-ServerAddressesNegativeTestJSON-1154083596-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.034731 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.035246 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.181135 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.182197 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.183218 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.183860 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.214798 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:37:16.226476 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for user 9b9d915eeb614cbdbfc3fe95d98d5373 and project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:37:16.246146 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 80fb5f1b-3a8c-43f2-87db-6e0cf87d5c24] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:37:16.247623 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.248366 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.263802 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 80fb5f1b-3a8c-43f2-87db-6e0cf87d5c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:37:16.266841 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.267445 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:16.337593 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:16.338006 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0dec645a-3af3-4013-a7f7-da2b4d4290cd tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.268828 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:37:48.319090 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.319502 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.449569 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.449973 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.450695 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.451089 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.516424 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Getting quotas for project c2ff3ae31d2448f191ebe8d515988727. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:37:48.534918 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Getting quotas for user 29538efe37884a61bd43358452446a5c and project c2ff3ae31d2448f191ebe8d515988727. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:37:48.574149 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] [instance: 3c4cbbd4-f7b8-44a3-b4cc-fa61d5066f70] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:37:48.574999 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.575402 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.606995 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] [instance: 3c4cbbd4-f7b8-44a3-b4cc-fa61d5066f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:37:48.608224 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.608663 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:48.669365 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:37:48.669778 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58a3d822-ccc7-43c7-9ff2-5fa5bc85599a tempest-ServerTagsTestJSON-1497943357 tempest-ServerTagsTestJSON-1497943357-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:37:52.389203 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:37:53.411597 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38198. Jul 26 03:38:04.110872 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Took 0.67 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:38:04.144114 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.145450 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.191456 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:38:04.208579 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.209159 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.210029 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.210641 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.230263 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.230688 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.257965 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:38:04.268212 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Getting quotas for user 9b9d915eeb614cbdbfc3fe95d98d5373 and project c9d1fc8ee46b4ae9b228536b179459d5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:38:04.282018 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 248be5c5-059d-440a-8e2e-edf47e8782fa] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:38:04.283257 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.283780 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.304718 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.305262 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.308239 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.308781 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.311842 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] [instance: 248be5c5-059d-440a-8e2e-edf47e8782fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:38:04.313219 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.314216 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.328843 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Getting quotas for project 26027fd5f2a249edbe26ebfec2945b61. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:38:04.334513 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Getting quotas for user 92a3c829138d436ab0e29e518b27e65e and project 26027fd5f2a249edbe26ebfec2945b61. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:38:04.349090 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] [instance: b9afbf98-2d6a-4dfa-aed6-358847767f92] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:38:04.350577 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.351098 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.360811 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] [instance: b9afbf98-2d6a-4dfa-aed6-358847767f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:38:04.362716 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.364426 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.364791 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.365632 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-42f99fab-7bae-4071-9e90-da15094f7b8a tempest-ImagesTestJSON-1758846018 tempest-ImagesTestJSON-1758846018-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:04.407598 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:04.407888 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6c0f5547-177b-481a-b842-d4914af8fae6 tempest-ImagesOneServerTestJSON-1115157933 tempest-ImagesOneServerTestJSON-1115157933-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:13.883162 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:38:14.910565 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38982. Jul 26 03:38:18.981117 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:38:19.003591 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.004004 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:19.060219 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.060581 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:19.061443 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.061968 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:19.079267 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:38:19.083865 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for user 411a2bbc6ee446729a2bfefa8002c55d and project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:38:19.095213 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 53b1d451-c77a-4f51-ab10-cb819c438b1e] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:38:19.096433 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.096875 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:19.105699 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 53b1d451-c77a-4f51-ab10-cb819c438b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:38:19.106962 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.107404 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:19.154928 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:19.155343 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d724dd32-958b-485d-95bb-0c562251c27f tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.195147 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:38:38.274826 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.275443 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.507415 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.507823 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.517905 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.523714 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.606914 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:38:38.621834 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:38:38.679814 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 45f29df8-cc49-4bce-a340-637417e77443] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:38:38.680854 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.681267 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.712482 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 45f29df8-cc49-4bce-a340-637417e77443] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:38:38.716074 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.716515 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:38.796034 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:38.796808 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-448ddce2-c793-4ec8-b233-078b216378c6 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.448254 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:38:52.477141 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.477566 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.550268 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.550844 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.551820 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.552686 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.574679 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:38:52.581993 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for user 411a2bbc6ee446729a2bfefa8002c55d and project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:38:52.594637 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 2e3785ef-3ef8-43cf-8633-c8b49311ab77] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:38:52.596008 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.596821 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.606939 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 2e3785ef-3ef8-43cf-8633-c8b49311ab77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:38:52.609775 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.610334 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:52.654126 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:38:52.654593 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-a4d00a9c-0800-46da-acf8-e99becd6d121 tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:38:53.089502 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:39:00.464012 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Took 0.46 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:00.503716 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.504347 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:00.599390 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.600115 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:00.601076 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.604266 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:00.646169 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Getting quotas for project d563c753504e4bc29b8ae56e77fd01a9. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:00.654772 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Getting quotas for user abb925beb14f4bac85e90365ddc4b95a and project d563c753504e4bc29b8ae56e77fd01a9. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:00.682912 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] [instance: 9e39afca-6b38-4229-8891-804503a47659] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:00.684348 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.687173 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:00.712802 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] [instance: 9e39afca-6b38-4229-8891-804503a47659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:00.715879 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.718071 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:00.781227 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:00.781924 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6ff62341-f808-404a-b75d-bd743396a0a7 tempest-VolumesNegativeTest-901150016 tempest-VolumesNegativeTest-901150016-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:04.782613 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:04.808427 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:04.809214 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:04.883197 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:04.883848 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:04.885075 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:04.885645 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:04.904812 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:04.910023 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:04.923874 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 1f8277d4-e2e3-4a6a-b7a3-897ef22d3b0a] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:04.925275 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:04.925856 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:04.935904 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 1f8277d4-e2e3-4a6a-b7a3-897ef22d3b0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:04.940354 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:04.944017 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:05.003311 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:05.004062 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-33da6f9c-61d2-4643-8b6e-db293a2fd2e4 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.527186 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Took 0.44 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:18.577084 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.577084 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.693709 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.696301 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.697685 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.698118 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.734346 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:18.744898 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for user d92dcbfbbc374cfdb139ae8f044dfc45 and project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:18.771529 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: a019c44d-3213-4647-b284-2025891c1590] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:18.772515 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.775291 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.791440 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: a019c44d-3213-4647-b284-2025891c1590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:18.793265 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.793741 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:18.849756 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:18.850589 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b8be173a-2495-4d9e-b455-7f4e7b6c2542 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.428218 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:22.507803 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.512733 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.664405 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.664934 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.665901 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.667765 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.696983 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:22.703321 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for user 411a2bbc6ee446729a2bfefa8002c55d and project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:22.724400 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: b5e8d7e0-b24a-44c6-938e-951d35059f02] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:22.725628 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.726756 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.738090 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: b5e8d7e0-b24a-44c6-938e-951d35059f02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:22.739327 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.739800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:22.804482 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:22.805530 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-67e1684b-83bb-4236-a5bf-20a8318b957c tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:25.339097 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:39:39.274462 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:39.307472 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.308116 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:39.398630 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.399038 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:39.399765 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.400159 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:39.435668 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Getting quotas for project 24e1e573662a46c2830ba58e54f6db6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:39.445537 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Getting quotas for user 9609e8ab5173421fbd66e36d38fabcff and project 24e1e573662a46c2830ba58e54f6db6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:39.457565 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] [instance: 62e086b6-fef6-4993-aa66-aecffad1582e] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:39.458556 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.459126 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:39.476480 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] [instance: 62e086b6-fef6-4993-aa66-aecffad1582e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:39.478175 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.478801 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:39.533576 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:39.534470 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c9976f33-ffdd-45ed-bea1-418d8fc508c2 tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.388703 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:50.421286 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.424828 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.525509 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.526238 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.527329 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.527949 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.545456 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:50.551051 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:50.563595 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: dd7fdf32-df61-4e0d-8623-f8c3453746bc] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:50.565015 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.565661 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.577726 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: dd7fdf32-df61-4e0d-8623-f8c3453746bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:50.580031 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.580855 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.648730 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.649597 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-85922790-f65d-4df7-94fb-e3ac70a546d5 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.673755 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:50.714833 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.715525 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.846537 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.847212 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.850224 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.851613 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.887871 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:50.903948 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for user b9105828537f439fad38f8927a0a3c69 and project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:50.916317 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: 8924f80a-5510-45b1-9de5-7049455bb479] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:50.917702 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.918392 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.933896 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: 8924f80a-5510-45b1-9de5-7049455bb479] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:50.935691 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.936325 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:50.993242 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:50.994019 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b29bf1b7-03a5-4ecf-b5d8-10cfca49ad6a tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.488081 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:39:52.524178 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.524549 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.642812 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.643225 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.650402 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.651499 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.699822 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:39:52.705649 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:39:52.725990 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 3f2e381a-2408-49da-878d-fe6b3435edb3] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:39:52.727267 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.727675 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.758719 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 3f2e381a-2408-49da-878d-fe6b3435edb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:39:52.760717 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.761836 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:39:52.801335 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:39:52.803009 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e7621868-bee5-4d8b-be3a-ded68a3dd819 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.355724 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:40:04.396780 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.397607 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.475594 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.476292 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.476850 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.477257 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.508833 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:40:04.516570 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Getting quotas for user 411a2bbc6ee446729a2bfefa8002c55d and project 4dc42b2c82d84f60afa9b5284f2c98c6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:40:04.531892 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 2d9a7809-1f42-4f91-aaee-30fcff41447b] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:40:04.532816 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.534279 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.548360 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] [instance: 2d9a7809-1f42-4f91-aaee-30fcff41447b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:40:04.550777 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.551323 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:04.604899 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:04.606314 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f45f195c-c219-4168-84b6-06db28ab70bc tempest-AttachVolumeNegativeTest-309491784 tempest-AttachVolumeNegativeTest-309491784-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.343351 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:40:08.362465 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.363131 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.414207 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.414620 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.415572 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.415972 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.432694 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Getting quotas for project 24e1e573662a46c2830ba58e54f6db6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:40:08.437266 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Getting quotas for user 9609e8ab5173421fbd66e36d38fabcff and project 24e1e573662a46c2830ba58e54f6db6b. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:40:08.448891 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] [instance: 31203d8b-72c0-4e1b-b01f-9f8f4b9c5bc0] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:40:08.450012 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.451759 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.463275 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] [instance: 31203d8b-72c0-4e1b-b01f-9f8f4b9c5bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:40:08.464646 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.465122 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:08.495510 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:08.496121 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d36841ff-648a-4eec-9f25-13ac026607cd tempest-SecurityGroupsTestJSON-1215057561 tempest-SecurityGroupsTestJSON-1215057561-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:15.999376 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:40:16.020686 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.021160 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:16.072158 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.072832 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:16.073762 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.074161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:16.090967 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:40:16.097040 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:40:16.111446 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: e86ecbd1-4d6e-43d1-86bb-e0274087ad88] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:40:16.113286 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.113820 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:16.122666 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: e86ecbd1-4d6e-43d1-86bb-e0274087ad88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:40:16.124044 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.124599 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:16.156249 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:16.156695 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3750a139-7e77-43a4-897b-f5137935f5c0 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.107390 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Took 0.34 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:40:44.139890 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.140310 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.195526 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.195946 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.196719 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.197301 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.217921 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Getting quotas for project b0a6c3230f294a6296ba33583cbcc6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:40:44.222951 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Getting quotas for user 46e28a039b934a39b52e1b6cb528cabd and project b0a6c3230f294a6296ba33583cbcc6ff. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:40:44.234800 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] [instance: e1cd621b-8304-462f-8dfa-1182355ce7b5] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:40:44.235750 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.236165 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.245890 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] [instance: e1cd621b-8304-462f-8dfa-1182355ce7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:40:44.247535 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.248169 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:44.297529 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:44.298630 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-22892f5b-d113-4fd6-8fba-b16cbce38ff7 tempest-InstanceActionsV221TestJSON-515637095 tempest-InstanceActionsV221TestJSON-515637095-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:51.921716 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:40:51.996932 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:51.997357 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:52.132380 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:52.133122 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:52.136333 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:52.136993 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:52.157222 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:40:52.165615 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for user b9105828537f439fad38f8927a0a3c69 and project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:40:52.180800 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: b054bc9d-3656-4972-803c-0c59787bde48] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:40:52.182221 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:52.182844 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:52.196946 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: b054bc9d-3656-4972-803c-0c59787bde48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:40:52.200457 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:52.201726 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:52.247134 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:40:52.247909 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e896a8e8-2749-4b43-ad9c-5a6f29c4a6e4 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:40:53.409334 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:40:54.430693 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 43234. Jul 26 03:41:05.598695 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Took 0.38 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:41:05.625658 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.626539 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:05.701842 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.702510 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:05.703673 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.704304 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:05.720689 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Getting quotas for project c4f9dcd825e54365b1ebec9a732447ed. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:41:05.731539 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Getting quotas for user e3fe598ca946434d9f10b109069df335 and project c4f9dcd825e54365b1ebec9a732447ed. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:41:05.747570 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] [instance: c140904d-87b9-4df5-9e59-bc05b819f9a3] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:41:05.748960 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.749677 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:05.780591 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] [instance: c140904d-87b9-4df5-9e59-bc05b819f9a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:41:05.783474 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.786548 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:05.840543 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:05.841046 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-ca4330e4-7c9e-4028-965c-75a061a906a1 tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:11.272961 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a689a83f-1eb5-4236-8720-486aae2794ff tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:41:11.273517 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a689a83f-1eb5-4236-8720-486aae2794ff tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:11.273876 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a689a83f-1eb5-4236-8720-486aae2794ff tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:11.320074 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a689a83f-1eb5-4236-8720-486aae2794ff tempest-ServerShowV254Test-1106452489 tempest-ServerShowV254Test-1106452489-project] [instance: c140904d-87b9-4df5-9e59-bc05b819f9a3] No migration record for the rebuild/evacuate request. {{(pid=99992) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:41:14.910476 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:41:15.945588 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 43784. Jul 26 03:41:27.701006 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:41:27.726559 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.727245 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:27.783039 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.783793 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:27.784794 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.785635 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:27.804876 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:41:27.812649 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:41:27.829987 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 07012ed2-bb7c-4c29-a1cd-7e42c2818615] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:41:27.831567 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.832201 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:27.842127 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 07012ed2-bb7c-4c29-a1cd-7e42c2818615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:41:27.843804 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.844430 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:27.902268 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:27.903105 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-443ffbf5-4584-4abe-8a6d-472048399699 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.449596 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Took 0.60 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:41:56.498352 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.499164 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.719962 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.720996 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.721095 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.721473 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.759946 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Getting quotas for project b3726f6d6a8e451eb5c3a4b5601b2832. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:41:56.789492 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Getting quotas for user aeff23f9640f456dae3bd4a50f669341 and project b3726f6d6a8e451eb5c3a4b5601b2832. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:41:56.828235 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] [instance: e90a8a80-704c-4c81-9183-6e92adb14165] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:41:56.830604 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.835001 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.850853 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] [instance: e90a8a80-704c-4c81-9183-6e92adb14165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:41:56.852191 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.852840 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:56.926571 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:56.927470 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f8093ef6-31cf-4efc-9494-20ff9d545f65 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:59.732886 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:41:59.771393 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:59.771811 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:59.871379 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:59.872058 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:59.873000 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:59.873563 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:59.895194 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:41:59.900378 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for user 03370ab9f4004c81b7eaf9aef8d240bd and project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:41:59.917557 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 13a89a0b-19d2-41ce-a3f9-02f50a125de2] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:41:59.921818 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:59.922838 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:41:59.942081 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 13a89a0b-19d2-41ce-a3f9-02f50a125de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:41:59.947249 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:41:59.948005 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:00.006689 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:00.011193 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bb285a6f-6db5-4c53-92bb-6587e0f56a60 tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:13.115571 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:42:16.791958 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:42:16.794712 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:16.795709 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:17.859026 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 13a89a0b-19d2-41ce-a3f9-02f50a125de2] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 03:42:18.723456 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Created allocations for migration aa2ae740-83b8-4065-ad39-5a03d9ca3437 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:42:19.248520 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:42:19.303055 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.304952 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.410626 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 13a89a0b-19d2-41ce-a3f9-02f50a125de2] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 03:42:19.478316 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.480631 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.481990 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.483189 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.529205 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:42:19.541607 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Getting quotas for user 20c014f777b649d7b49c0afe424ea31c and project f220ef0a6cdf4d119fbf98563e9d9e7f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:42:19.565611 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 1dcc146f-8b3a-49fd-80ea-db55b00502a0] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:42:19.568244 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.568951 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.585537 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] [instance: 1dcc146f-8b3a-49fd-80ea-db55b00502a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:42:19.589600 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.592947 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.684643 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:19.685270 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-61251455-9f9b-4619-ad12-3033ea261d97 tempest-DeleteServersTestJSON-21634278 tempest-DeleteServersTestJSON-21634278-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:19.709202 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 114}}, 'project_id': 'f8c79845781f428a93244060c0b538a6', 'user_id': '03370ab9f4004c81b7eaf9aef8d240bd', 'consumer_generation': 1} on consumer 13a89a0b-19d2-41ce-a3f9-02f50a125de2 {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 03:42:19.997350 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Created allocations for instance 13a89a0b-19d2-41ce-a3f9-02f50a125de2 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 03:42:20.261814 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:42:20.267614 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: 13a89a0b-19d2-41ce-a3f9-02f50a125de2] Setting instance to ACTIVE state. Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-b53fd97f-5bca-45c8-bb04-0f1df396da7c tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 03:42:20.487719 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 03:42:20.490496 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 03:42:20.492887 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:42:20.492887 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 03:42:26.436369 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:42:26.481929 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.482326 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:26.598333 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.604075 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:26.606908 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.608867 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:26.651187 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Getting quotas for project b3726f6d6a8e451eb5c3a4b5601b2832. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:42:26.662090 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Getting quotas for user aeff23f9640f456dae3bd4a50f669341 and project b3726f6d6a8e451eb5c3a4b5601b2832. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:42:26.692416 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] [instance: 9f410b56-877e-4ca1-aed4-c464735e8d59] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:42:26.698786 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.699325 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:26.712426 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] [instance: 9f410b56-877e-4ca1-aed4-c464735e8d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:42:26.714029 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.714669 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:26.774113 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:26.775120 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-07abe138-0da9-4fab-83bb-0482a74d61d7 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:30.828160 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:42:30.859812 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:30.863726 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:31.017106 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:31.017789 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:31.018718 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:31.020336 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:31.058070 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:42:31.071425 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Getting quotas for user b9105828537f439fad38f8927a0a3c69 and project bd432caff809466e8ee5806cd78e21df. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:42:31.086409 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: 65ba9c8b-36b3-4fac-81ef-b12cb51653eb] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:42:31.087645 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:31.088430 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:31.101454 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] [instance: 65ba9c8b-36b3-4fac-81ef-b12cb51653eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:42:31.104954 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:31.109367 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:31.219898 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:31.220342 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0bb7d9fc-7d89-4145-b11b-a4ff1023be02 tempest-TestNetworkBasicOps-667341585 tempest-TestNetworkBasicOps-667341585-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.431892 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:42:44.471622 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.472922 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.547202 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.547895 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.549507 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.550467 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.577309 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:42:44.587334 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for user d92dcbfbbc374cfdb139ae8f044dfc45 and project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:42:44.607389 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: 44afc4f3-d499-4eb5-8ebc-590cd663e096] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:42:44.608956 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.610995 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.634820 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: 44afc4f3-d499-4eb5-8ebc-590cd663e096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:42:44.636637 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.637155 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:42:44.699125 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:42:44.699872 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-94ad6b03-0132-4f4b-99f6-f300731b9ce4 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.689654 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Took 0.73 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:43:37.722231 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.722748 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.777278 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.777751 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.778603 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.779011 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.799948 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:43:37.805598 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for user d92dcbfbbc374cfdb139ae8f044dfc45 and project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:43:37.877424 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: 59c9c3f5-23b7-4c74-8816-b466bb4d9daf] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:43:37.882653 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.884085 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.915394 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: 59c9c3f5-23b7-4c74-8816-b466bb4d9daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:43:37.922499 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.922973 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:37.988796 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:37.989886 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f53b2498-66ee-439d-af75-a8a7fc3f2988 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:54.431641 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:43:55.449592 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 47228. Jul 26 03:43:57.111141 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:43:57.131995 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.132413 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.187234 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.187648 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.188386 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.189393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.204501 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Getting quotas for project ed79928c66d84592ac6821495ec18f49. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:43:57.210829 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Getting quotas for user 417c34ba419a4a35b63dc6246a5f8d4a and project ed79928c66d84592ac6821495ec18f49. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:43:57.224304 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] [instance: e00a8075-dcf7-4972-a8cd-eb691ab1db67] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:43:57.225453 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.225884 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.234475 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] [instance: e00a8075-dcf7-4972-a8cd-eb691ab1db67] block_device_mapping [BlockDeviceMapping(attachment_id=eb0d40ac-8d94-49dd-8ea8-e6f50d9462f3,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='344f0589-565c-4099-b5a8-c0dcecfeb2cb',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=9349061c-a58a-4abd-a520-27b5ec18e393,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cbb6dc71-6e26-4908-af0d-d28503644b30',volume_size=1,volume_type=None), BlockDeviceMapping(attachment_id=92540f55-a5b8-4281-a58b-2792e5508f8a,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95e15cf5-796f-4630-a99e-ea79971edd31',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:43:57.236884 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.237299 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.246112 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.246732 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.256229 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.256996 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:43:57.300573 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:43:57.301974 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-4308f63c-28d6-4f44-afea-7758c6e034e2 tempest-TaggedBootDevicesTest-1650987098 tempest-TaggedBootDevicesTest-1650987098-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:44:15.943103 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:44:16.962550 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 47604. Jul 26 03:44:25.364220 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:44:29.000168 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method unshelve_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:44:29.001181 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:44:29.001629 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:44:29.538734 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] [instance: e90a8a80-704c-4c81-9183-6e92adb14165] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) during scheduling {{(pid=99991) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jul 26 03:44:29.781334 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Took 0.24 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:44:29.794361 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-bea8231d-170e-4e65-aa31-400b633d0344 tempest-ServersNegativeTestJSON-843030557 tempest-ServersNegativeTestJSON-843030557-project] Lazy-loading 'flavor' on Instance uuid e90a8a80-704c-4c81-9183-6e92adb14165 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:45:33.145046 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:45:39.792526 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:45:39.854310 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:39.859046 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:39.952181 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:39.952935 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:39.954161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:39.955437 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:39.995982 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:45:40.003344 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for user d92dcbfbbc374cfdb139ae8f044dfc45 and project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:45:40.020901 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: b2108d98-a416-4165-b375-f2d8577ac6e0] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:45:40.022254 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:40.022883 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:40.032844 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: b2108d98-a416-4165-b375-f2d8577ac6e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:45:40.034702 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:40.035439 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:40.081908 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:40.082618 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d61168a-2f9e-425b-8665-b200429c13b7 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.064340 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:45:48.085457 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.085976 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.158803 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.159220 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.163694 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.164307 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.203464 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:45:48.208203 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for user 481f1537bc354719b4a170b293cc6d25 and project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:45:48.231139 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: 48fce39e-a58f-41bb-942f-a3ef3a1f8fd6] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:45:48.232103 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.233766 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.250937 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: 48fce39e-a58f-41bb-942f-a3ef3a1f8fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:45:48.252398 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.252858 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:48.309210 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:48.309913 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0d5b12e6-6108-4ac9-8fc3-8692ac97b978 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.181406 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:45:58.220353 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.221188 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.284234 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.284941 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.286025 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.286722 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.306313 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:45:58.316240 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Getting quotas for user d92dcbfbbc374cfdb139ae8f044dfc45 and project cc4cf2b70bc14d489b8c32fa3511bcfa. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:45:58.332576 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: ecabeacd-e90e-4b58-93cd-d54d84ba06d6] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:45:58.333850 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.334369 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.344010 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] [instance: ecabeacd-e90e-4b58-93cd-d54d84ba06d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:45:58.346402 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.347049 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:45:58.400775 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:45:58.401313 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a92ed1a9-6814-4ad5-865a-588d6e2fd6d6 tempest-ServerActionsTestJSON-1376525286 tempest-ServerActionsTestJSON-1376525286-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:00.534670 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-48c2edfb-25dd-4474-8804-460e26f12950 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:46:00.537165 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-48c2edfb-25dd-4474-8804-460e26f12950 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:00.537698 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-48c2edfb-25dd-4474-8804-460e26f12950 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:00.572226 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-48c2edfb-25dd-4474-8804-460e26f12950 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: 48fce39e-a58f-41bb-942f-a3ef3a1f8fd6] No migration record for the rebuild/evacuate request. {{(pid=99991) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:46:07.686253 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:46:07.720819 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.721118 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:07.801492 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.801990 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:07.802807 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.803259 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:07.820696 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Getting quotas for project cd5065f9541e4727b04b6b1193babd74. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:46:07.828703 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Getting quotas for user 71c37289764a474db16cb51e09e9f9d0 and project cd5065f9541e4727b04b6b1193babd74. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:46:07.841042 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] [instance: 62c0c4dc-5ea3-4c6a-8cd9-cf8bea74057e] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:46:07.842280 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.843009 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:07.854413 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] [instance: 62c0c4dc-5ea3-4c6a-8cd9-cf8bea74057e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:46:07.856115 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.856717 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:07.908118 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:07.909030 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-ccca8699-f670-4996-a200-85d4f9927705 tempest-VolumesActionsTest-1473172346 tempest-VolumesActionsTest-1473172346-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:39.788661 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Took 0.41 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:46:39.828608 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:39.828867 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:39.909405 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:39.909900 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:39.910965 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:39.912302 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:39.970770 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:46:39.976800 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for user 481f1537bc354719b4a170b293cc6d25 and project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:46:39.988520 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: ecddbe4d-37e6-4296-995d-1ebdfba042be] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:46:39.989678 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:39.990252 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:39.998829 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: ecddbe4d-37e6-4296-995d-1ebdfba042be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:46:40.001065 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:40.001820 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:40.039460 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:40.040393 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-47d59df1-affe-45bc-b4af-2d206a982675 tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:53.728876 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a50ab832-30c2-49c0-835c-e9dff1feb45d tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:46:53.732858 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a50ab832-30c2-49c0-835c-e9dff1feb45d tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:46:53.733650 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a50ab832-30c2-49c0-835c-e9dff1feb45d tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:46:53.753137 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a50ab832-30c2-49c0-835c-e9dff1feb45d tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: ecddbe4d-37e6-4296-995d-1ebdfba042be] No migration record for the rebuild/evacuate request. {{(pid=99992) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:46:55.452528 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:46:56.473732 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 52272. Jul 26 03:47:04.600099 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:47:04.636520 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.637449 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:04.763163 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.763845 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:04.766241 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.767349 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:04.791391 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Getting quotas for project 53b40037451e46bc8544478ee4f23ccb. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:47:04.797225 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Getting quotas for user 4528b279e0ed44b8a4a99430666d7e0e and project 53b40037451e46bc8544478ee4f23ccb. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:47:04.808567 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] [instance: e1ce6cb3-08f1-4526-8021-d1f8d3d568bf] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:47:04.809923 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.810506 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:04.821681 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] [instance: e1ce6cb3-08f1-4526-8021-d1f8d3d568bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:47:04.824605 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.825407 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:04.896890 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:04.897308 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f04b8eed-9c03-4f88-8384-4c10d9b4df28 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:16.966006 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:47:17.991188 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 53062. Jul 26 03:47:22.306461 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:47:22.374418 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.375181 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:22.457698 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.458455 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:22.458832 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.459228 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:22.500166 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Getting quotas for project 53b40037451e46bc8544478ee4f23ccb. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:47:22.505581 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Getting quotas for user 4528b279e0ed44b8a4a99430666d7e0e and project 53b40037451e46bc8544478ee4f23ccb. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:47:22.533545 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] [instance: f7a7df25-4b00-48e3-99af-05e55c27fc1f] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:47:22.534610 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.535144 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:22.544667 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] [instance: f7a7df25-4b00-48e3-99af-05e55c27fc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:47:22.545976 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.546399 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:22.577813 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:22.578483 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c59f2b2c-b273-4bbd-80f7-ed524e2e8c23 tempest-VolumesActionsTest-899452484 tempest-VolumesActionsTest-899452484-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:26.768134 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Took 0.45 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:47:26.794702 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:26.795663 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:26.878758 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:26.879421 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:26.880280 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:26.881091 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:26.898970 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Getting quotas for project 7aaeabc091db48c99477303af92ff200. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:47:26.904730 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Getting quotas for user f5752d4c21c742828a95e434501bb9b8 and project 7aaeabc091db48c99477303af92ff200. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:47:26.918345 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] [instance: dac791c8-8135-49b0-b63e-c5502c6d4a49] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:47:26.919455 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:26.920023 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:26.929829 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] [instance: dac791c8-8135-49b0-b63e-c5502c6d4a49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:47:26.931595 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:26.932258 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:27.006742 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:27.007218 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d1064640-18ba-4775-8c2f-bf2294e084d3 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.284602 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:47:30.318658 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.319103 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.320075 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-45c02bf4-7c1d-4fab-96e6-46f19dd6f684 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:47:30.321299 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-45c02bf4-7c1d-4fab-96e6-46f19dd6f684 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.323065 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-45c02bf4-7c1d-4fab-96e6-46f19dd6f684 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.354596 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-45c02bf4-7c1d-4fab-96e6-46f19dd6f684 tempest-ServerShowV257Test-156349424 tempest-ServerShowV257Test-156349424-project] [instance: dac791c8-8135-49b0-b63e-c5502c6d4a49] No migration record for the rebuild/evacuate request. {{(pid=99991) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 03:47:30.425781 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.426196 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.426922 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.427312 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.465560 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:47:30.475678 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Getting quotas for user 481f1537bc354719b4a170b293cc6d25 and project dcff26be9e1a4d41a4ec952e40d8fcc5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:47:30.496675 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: a89733c7-eea3-455a-b531-2abaccff5c39] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:47:30.499421 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.500142 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.529534 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] [instance: a89733c7-eea3-455a-b531-2abaccff5c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:47:30.533033 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.536493 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:30.600795 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:30.601214 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-60c3d483-9cf9-4954-857b-3193741b1c0e tempest-ServerDiskConfigTestJSON-212901176 tempest-ServerDiskConfigTestJSON-212901176-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:53.717995 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:53.717995 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.258470 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:47:54.309821 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.310484 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.398228 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.398872 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.399789 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.402618 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.439925 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Getting quotas for project 8d70f4f5811c472bb29816f7013f30f5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:47:54.448320 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Getting quotas for user a27e50fd999440de8298b0d2555dfea9 and project 8d70f4f5811c472bb29816f7013f30f5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:47:54.470157 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] [instance: 789affbe-4d86-43cf-bcb5-1e63103bd3bd] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:47:54.471161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.471572 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.485660 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] [instance: 789affbe-4d86-43cf-bcb5-1e63103bd3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:47:54.486973 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.487386 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:47:54.539573 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:47:54.539881 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c8ce46f-aa77-4af5-a47c-dd366176de71 tempest-ServerGroupTestJSON-1542263964 tempest-ServerGroupTestJSON-1542263964-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.304413 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Took 0.63 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:48:21.368622 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.372191 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.532146 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.533677 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.535155 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.536691 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.620265 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Getting quotas for project 17daf5cd0bf64a32a9fef68512618b37. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:48:21.648723 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Getting quotas for user 5fac011cee1f4b1cba612a662536c532 and project 17daf5cd0bf64a32a9fef68512618b37. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:48:21.679740 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] [instance: 5f7b8515-0339-4256-956a-1c643155480e] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:48:21.681206 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.682421 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.695829 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] [instance: 5f7b8515-0339-4256-956a-1c643155480e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:48:21.698133 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.698576 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:21.773789 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:21.775027 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da6a3920-ecf3-4c0f-86c1-f718e8cc30a2 tempest-ServerPasswordTestJSON-554874971 tempest-ServerPasswordTestJSON-554874971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:22.850517 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Took 0.49 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:48:22.921993 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:22.926510 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:23.041779 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:23.042202 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:23.042942 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:23.043339 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:23.099518 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:48:23.113558 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Getting quotas for user 03370ab9f4004c81b7eaf9aef8d240bd and project f8c79845781f428a93244060c0b538a6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:48:23.130563 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: fadcd943-b135-464b-86d4-3bc67775de3d] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:48:23.133066 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:23.143242 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:23.167375 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] [instance: fadcd943-b135-464b-86d4-3bc67775de3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:48:23.171112 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:23.172507 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:23.242669 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:23.243181 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-2c2dcddc-fee4-453b-8f22-72f4dcf0277f tempest-MigrationsAdminTest-1040519502 tempest-MigrationsAdminTest-1040519502-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:25.718579 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:48:25.757505 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:25.758140 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:25.900824 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:25.901384 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:25.902129 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:25.902529 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:25.952851 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Getting quotas for project c32f1e54ef2b409d960e79bbae68d08a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:48:25.958254 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Getting quotas for user 6cf8bd0a0b784534b3641f22e1e62f6c and project c32f1e54ef2b409d960e79bbae68d08a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:48:25.985088 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 7c1fd4d6-4e72-4443-886f-6a584a86e2a4] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:48:25.986502 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:25.987076 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:26.009084 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 7c1fd4d6-4e72-4443-886f-6a584a86e2a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:48:26.011006 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:26.011417 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:26.132497 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:26.132912 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-112ae9f5-d1e5-42ac-a587-df9f2a85e4a8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:42.568281 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:48:42.568808 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:42.573273 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:42.846351 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: fadcd943-b135-464b-86d4-3bc67775de3d] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 03:48:43.451419 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Created allocations for migration fa711561-033b-4cbb-9494-d048cea10df2 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:48:44.408061 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: fadcd943-b135-464b-86d4-3bc67775de3d] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 03:48:44.943544 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 133}}, 'project_id': 'f8c79845781f428a93244060c0b538a6', 'user_id': '03370ab9f4004c81b7eaf9aef8d240bd', 'consumer_generation': 1} on consumer fadcd943-b135-464b-86d4-3bc67775de3d {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 03:48:45.080406 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Created allocations for instance fadcd943-b135-464b-86d4-3bc67775de3d on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 03:48:45.135374 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:48:45.136667 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] [instance: fadcd943-b135-464b-86d4-3bc67775de3d] Setting instance to ACTIVE state. Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-f414625e-dae4-4bf6-9fad-21090f093bee tempest-MigrationsAdminTest-148698452 tempest-MigrationsAdminTest-148698452-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 03:48:45.328581 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 03:48:45.329536 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 03:48:45.330628 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:48:45.330628 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 03:48:55.673356 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:48:55.694909 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.695324 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:55.782257 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.782674 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:55.783434 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.783801 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:55.805430 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Getting quotas for project ca73e3910f634551889043b9ee5e3c16. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:48:55.812244 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Getting quotas for user b0b5f5f07c634e609472c41cc1b7ee76 and project ca73e3910f634551889043b9ee5e3c16. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:48:55.824546 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] [instance: b7a3ef85-d719-4264-8c50-449bde072dd2] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:48:55.825872 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.826504 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:55.848084 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] [instance: b7a3ef85-d719-4264-8c50-449bde072dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:48:55.853601 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.854331 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:48:55.937623 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:48:55.938036 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-12537652-dcf4-4004-a959-48b3034a6884 tempest-ServerRescueTestJSONUnderV235-427681156 tempest-ServerRescueTestJSONUnderV235-427681156-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.602063 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:49:35.629674 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.630087 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.683492 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.683992 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.684886 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.685384 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.702350 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Getting quotas for project 078127b487294c199714a9029ea9566e. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:49:35.706999 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Getting quotas for user 298997549abc4eb990f3a34e6ebfc7ba and project 078127b487294c199714a9029ea9566e. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:49:35.721663 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] [instance: fea231e4-06ef-4914-bc4f-0d312cea3e1f] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:49:35.722761 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.723429 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.730855 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] [instance: fea231e4-06ef-4914-bc4f-0d312cea3e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:49:35.732218 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.732738 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:35.775923 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:49:35.776339 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-fc27815f-ec66-4238-9f72-df1625ecedd7 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:49:56.475990 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:49:57.495860 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60078. Jul 26 03:50:01.649986 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Took 0.48 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:50:01.687332 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.688007 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:01.771832 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.772909 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:01.773824 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.774385 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:01.793977 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Getting quotas for project e6b50d6ce4294753bf169a229d9b4d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:50:01.798524 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Getting quotas for user f871f3f8315749a8ad0f36e1a6939ef6 and project e6b50d6ce4294753bf169a229d9b4d5c. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:50:01.810633 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] [instance: d645935d-569f-4d60-bb08-e2ec8732157f] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:50:01.811655 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.814967 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:01.823848 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] [instance: d645935d-569f-4d60-bb08-e2ec8732157f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:50:01.825157 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.825578 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:01.870313 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:01.870825 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f3e18d4e-78d9-4b87-ba51-49e51e07bb69 tempest-ServersNegativeTestMultiTenantJSON-1866937449 tempest-ServersNegativeTestMultiTenantJSON-1866937449-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:17.985844 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:50:19.003140 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60492. Jul 26 03:50:33.169771 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:50:53.529045 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:50:53.557144 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.557819 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:53.635862 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.636166 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:53.639393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.641513 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:53.664465 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Getting quotas for project 078127b487294c199714a9029ea9566e. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:50:53.673221 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Getting quotas for user 298997549abc4eb990f3a34e6ebfc7ba and project 078127b487294c199714a9029ea9566e. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:50:53.700021 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] [instance: b6a18795-fb63-47f4-a3dd-a5abcaa11a01] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:50:53.702122 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.703087 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:53.714029 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] [instance: b6a18795-fb63-47f4-a3dd-a5abcaa11a01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:50:53.715958 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.717030 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:50:53.775072 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:50:53.775856 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-30dcc24f-4b5e-4331-94af-c42ac2d3cb06 tempest-VolumesSnapshotTestJSON-1881544978 tempest-VolumesSnapshotTestJSON-1881544978-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:04.341830 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method unshelve_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:51:04.342401 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:04.347713 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:05.177942 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 7c1fd4d6-4e72-4443-886f-6a584a86e2a4] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) during scheduling {{(pid=99991) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jul 26 03:51:05.441697 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:51:05.448837 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-eb0db755-422d-4097-8bc7-800ba28d66cc tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lazy-loading 'flavor' on Instance uuid 7c1fd4d6-4e72-4443-886f-6a584a86e2a4 {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:51:41.099113 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:51:41.119637 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.120043 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:41.175328 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.175765 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:41.176502 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.176915 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:41.193879 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Getting quotas for project 6ff7e364f94d483191c4617bf3101757. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:51:41.198279 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Getting quotas for user 478e65dbc229446097997103da90eb95 and project 6ff7e364f94d483191c4617bf3101757. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:51:41.209807 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] [instance: 4a5e0fa8-d3c5-44b1-8464-845eda1ca9c5] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:51:41.210959 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.211362 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:41.219414 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] [instance: 4a5e0fa8-d3c5-44b1-8464-845eda1ca9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:51:41.221012 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.221416 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:51:41.254680 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:51:41.255139 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-3dca8d3e-9c2e-42f3-b2ff-f285cad71adb tempest-TestServerAdvancedOps-1947613572 tempest-TestServerAdvancedOps-1947613572-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.797146 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:52:21.821141 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.821551 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.865687 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.866393 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.867321 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.867733 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.884790 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Getting quotas for project c32f1e54ef2b409d960e79bbae68d08a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:52:21.889300 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Getting quotas for user 6cf8bd0a0b784534b3641f22e1e62f6c and project c32f1e54ef2b409d960e79bbae68d08a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:52:21.900586 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 3eee336b-accc-474f-a839-629a47b1260c] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:52:21.901808 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.902225 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.920665 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 3eee336b-accc-474f-a839-629a47b1260c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:52:21.922544 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.923080 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:21.953264 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:52:21.953775 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-3cea227b-4693-436c-9eb9-081f12487ae8 tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:52:57.495947 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:52:58.513008 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35832. Jul 26 03:53:19.006261 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:53:20.023670 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36098. Jul 26 03:53:46.879887 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Took 0.39 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:53:46.897938 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:46.898161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:46.947508 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:46.947906 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:46.948674 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:46.949056 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:46.964113 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Getting quotas for project 17e0943bf3b947d7bdc2f5bd8a3bd4c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:53:46.968696 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Getting quotas for user 1a2d2ed8652e4f5098239666a1b6cac7 and project 17e0943bf3b947d7bdc2f5bd8a3bd4c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:53:46.979673 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] [instance: 3d943d2a-1747-4344-9e3c-084fc82db884] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:53:46.980638 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:46.981039 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:46.988417 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] [instance: 3d943d2a-1747-4344-9e3c-084fc82db884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:53:46.989670 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:46.990072 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:47.015622 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:53:47.016132 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-694e00b5-b799-4de1-b754-2f9bdde333d9 tempest-InstanceActionsNegativeTestJSON-1572491001 tempest-InstanceActionsNegativeTestJSON-1572491001-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:53:53.193272 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:54:04.114189 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Took 0.35 seconds to select destinations for 2 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:54:04.133318 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.133813 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.208107 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.208557 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.252305 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.252760 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.253469 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.253863 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.270307 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Getting quotas for project b4d36adc30284989ac6af75e8caec1a8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:54:04.274834 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Getting quotas for user 036e310f811b4543b98ac391f51406a3 and project b4d36adc30284989ac6af75e8caec1a8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:54:04.285864 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: d95f51b5-b568-4a92-ac25-9ce9023a8b2a] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:54:04.286805 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.287211 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.294115 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: d95f51b5-b568-4a92-ac25-9ce9023a8b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:54:04.295287 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.295694 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.331613 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.332076 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.343364 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: 09b0d886-1181-4845-bc7b-5be7f25960ca] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:54:04.344623 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.345251 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.354450 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: 09b0d886-1181-4845-bc7b-5be7f25960ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:54:04.356745 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.357231 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:04.398183 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:04.398681 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d58d5be4-d2e2-4869-ae65-21b31c2afa9e tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.641834 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Took 0.31 seconds to select destinations for 2 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:54:17.661883 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.662387 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.716278 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.716709 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.759800 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.760249 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.761843 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.762579 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.777045 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Getting quotas for project b4d36adc30284989ac6af75e8caec1a8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:54:17.782182 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Getting quotas for user 036e310f811b4543b98ac391f51406a3 and project b4d36adc30284989ac6af75e8caec1a8. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:54:17.794677 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: 1bcc9422-dead-4d95-9072-f05ea113c6b0] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:54:17.795616 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.796009 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.803838 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: 1bcc9422-dead-4d95-9072-f05ea113c6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:54:17.805505 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.805901 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.836722 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.837271 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.847908 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: ce97840d-9c7a-4729-a7e0-5a20023ab38c] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:54:17.848843 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.849243 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.859715 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] [instance: ce97840d-9c7a-4729-a7e0-5a20023ab38c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:54:17.873451 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.874220 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:17.954241 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:17.954886 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9a778de2-da21-49c9-9c35-54c5acbe1e41 tempest-MultipleCreateTestJSON-962336552 tempest-MultipleCreateTestJSON-962336552-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:25.403442 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:54:41.479643 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method unshelve_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:54:41.480164 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:41.480974 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:42.259944 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] [instance: 3eee336b-accc-474f-a839-629a47b1260c] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) during scheduling {{(pid=99991) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jul 26 03:54:42.668134 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:54:42.676265 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-2369bcd4-c84e-4902-a539-f305e67b16ea tempest-AttachVolumeShelveTestJSON-1308408515 tempest-AttachVolumeShelveTestJSON-1308408515-project] Lazy-loading 'flavor' on Instance uuid 3eee336b-accc-474f-a839-629a47b1260c {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 03:54:51.054564 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Took 0.75 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:54:51.137262 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.141715 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:51.243326 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.244029 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:51.244962 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.245499 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:51.265963 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Getting quotas for project ec550d3aad3440e080c2854b010d388f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:54:51.273437 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Getting quotas for user 32ca96a518964478ac8e1b71759f8bb3 and project ec550d3aad3440e080c2854b010d388f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:54:51.306605 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] [instance: 500f89e9-4bcc-448f-bc49-fe475d17d654] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:54:51.307803 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.308427 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:51.317903 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] [instance: 500f89e9-4bcc-448f-bc49-fe475d17d654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:54:51.319866 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.320745 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:54:51.368377 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:54:51.369119 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8d0d33ba-f010-4707-88f7-b021fbdfd45c tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.370587 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:55:09.394776 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.395186 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.445576 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.446242 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.447184 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.447574 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.462639 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Getting quotas for project 732e0935c58e4adebbd86284fc34b380. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:55:09.467874 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Getting quotas for user c3ffb60cb93445b1b2517e124eefd853 and project 732e0935c58e4adebbd86284fc34b380. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:55:09.478551 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] [instance: e948e082-cf91-4d71-a2ca-b741e23b7bd0] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:55:09.479452 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.479854 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.487240 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] [instance: e948e082-cf91-4d71-a2ca-b741e23b7bd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:55:09.488528 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.488913 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:09.515702 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:09.516110 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2f4451e1-c935-48b6-ba54-50bf4b844b5f tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.505012 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:55:19.524772 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.525267 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.572475 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.572902 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.573702 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.574209 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.594969 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Getting quotas for project 732e0935c58e4adebbd86284fc34b380. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:55:19.599522 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Getting quotas for user c3ffb60cb93445b1b2517e124eefd853 and project 732e0935c58e4adebbd86284fc34b380. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:55:19.610419 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] [instance: a5bdb60e-56a7-4379-845e-4ef31737aae2] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:55:19.611348 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.611751 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.618150 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] [instance: a5bdb60e-56a7-4379-845e-4ef31737aae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:55:19.619389 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.619793 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:19.646723 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:19.647131 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c10d19f2-96d6-4848-a772-91c3fc0eeca8 tempest-ServersAdminNegativeTestJSON-1443667338 tempest-ServersAdminNegativeTestJSON-1443667338-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.738911 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Took 0.27 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:55:30.759443 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.760056 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.817576 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.818136 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.819025 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.819501 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.855002 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:55:30.859953 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for user c1144c78da014bb29236350561d29a12 and project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:55:30.873319 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: 9ebc3041-3143-4ba9-801b-029b9f6edbab] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:55:30.874785 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.875361 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.883164 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: 9ebc3041-3143-4ba9-801b-029b9f6edbab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:55:30.884819 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.885436 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:30.924074 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:30.924936 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-16bd7f36-de16-477c-b2f9-17a502fc3dcb tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:55.971862 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Took 0.25 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:55:55.991830 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:55.992570 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.046132 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.046437 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.047152 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.047535 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.064704 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Getting quotas for project f23425aa791044eb8385c42813a33790. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:55:56.069110 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Getting quotas for user 9185971a1fd74e3e8055a7fe04565a58 and project f23425aa791044eb8385c42813a33790. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:55:56.080790 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] [instance: f946c9d8-7877-490f-a689-b5208bf4ecf3] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:55:56.081713 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.082104 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.089305 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] [instance: f946c9d8-7877-490f-a689-b5208bf4ecf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:55:56.091010 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.091403 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.119568 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.119971 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f18d07b1-6892-4e61-9dcf-1ae8a80caac3 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.464858 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:55:56.483826 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.484240 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.529800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.529800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.529800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.529800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.546447 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Getting quotas for project f23425aa791044eb8385c42813a33790. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:55:56.552236 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Getting quotas for user 9185971a1fd74e3e8055a7fe04565a58 and project f23425aa791044eb8385c42813a33790. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:55:56.565102 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] [instance: 6438abd3-ca49-486e-978f-04fb6b933a68] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:55:56.566101 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.566519 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.575810 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] [instance: 6438abd3-ca49-486e-978f-04fb6b933a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:55:56.577570 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.578084 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:56.614434 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:55:56.615001 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-83dae2e7-0ae8-45e4-bf1a-1ed18fb19115 tempest-ListImageFiltersTestJSON-146163805 tempest-ListImageFiltersTestJSON-146163805-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:55:58.514515 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:55:59.537650 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39718. Jul 26 03:56:19.243046 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 03:56:19.243694 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:56:19.243939 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:56:19.527710 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: 9ebc3041-3143-4ba9-801b-029b9f6edbab] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 03:56:19.915441 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Created allocations for migration d7fe4333-f52b-4418-9982-4dc84d126bf1 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 03:56:20.025483 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 03:56:20.181266 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: 9ebc3041-3143-4ba9-801b-029b9f6edbab] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 03:56:20.389381 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 159}}, 'project_id': 'b248b60c2e5e44fa8c87deee1ca56aab', 'user_id': 'c1144c78da014bb29236350561d29a12', 'consumer_generation': 1} on consumer 9ebc3041-3143-4ba9-801b-029b9f6edbab {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 03:56:20.492928 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Created allocations for instance 9ebc3041-3143-4ba9-801b-029b9f6edbab on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 03:56:20.545252 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:56:20.547756 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: 9ebc3041-3143-4ba9-801b-029b9f6edbab] Setting instance to ACTIVE state. Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-8cd7dfc3-cdd9-4139-ad84-98b1a3ccbd7b tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 03:56:20.662022 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 03:56:20.663476 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 03:56:20.665105 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 03:56:20.665105 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 03:56:21.053493 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40718. Jul 26 03:57:13.210055 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:57:18.921930 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:57:18.941205 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:18.941891 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:19.002157 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:19.002571 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:19.003537 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:19.004393 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:19.022484 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Getting quotas for project b8f8bf5357ef4216bad205805fd9eb69. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:57:19.027957 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Getting quotas for user 9b9e5af9606f4805929c31d52f6428b2 and project b8f8bf5357ef4216bad205805fd9eb69. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:57:19.046021 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] [instance: 2aa40c1a-cf15-4c7b-945a-22132a424afd] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:57:19.047439 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:19.047936 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:19.057146 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] [instance: 2aa40c1a-cf15-4c7b-945a-22132a424afd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:57:19.059456 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:19.059855 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:19.096523 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:57:19.096927 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7bbbff0-e454-435e-804e-a5a53e0a10bc tempest-ServersTestManualDisk-1438215729 tempest-ServersTestManualDisk-1438215729-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:57:57.286373 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:58:34.524051 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:58:34.552415 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.552913 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:34.601848 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.602259 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:34.603647 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.604035 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:34.621331 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:58:34.626037 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:58:34.637514 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 33ca7b4b-7008-4e0b-94f9-c4ee080040c1] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:58:34.638539 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.638937 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:34.646418 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 33ca7b4b-7008-4e0b-94f9-c4ee080040c1] block_device_mapping [BlockDeviceMapping(attachment_id=7b900832-fb57-4575-9188-0d0adf0f3fd9,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f773e987-02a6-4ccf-962a-44ddbde43858',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:58:34.647924 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.648540 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:34.678632 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:34.679241 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0d1c11fb-6a8f-4639-a3c7-b2e1c8774c93 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:37.953387 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:58:37.975375 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:37.976045 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:38.047233 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:38.047645 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:38.050322 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:38.054497 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:38.079997 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Getting quotas for project ec550d3aad3440e080c2854b010d388f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:58:38.087744 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Getting quotas for user 32ca96a518964478ac8e1b71759f8bb3 and project ec550d3aad3440e080c2854b010d388f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:58:38.100780 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] [instance: 2d97789e-71e5-47dc-8c58-f6b32a6d9bcc] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:58:38.102408 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:38.103177 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:38.113106 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] [instance: 2d97789e-71e5-47dc-8c58-f6b32a6d9bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:58:38.115158 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:38.115666 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:38.151697 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:58:38.152333 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-01979b2a-6681-4c0d-97fa-39d448eb86bb tempest-AttachVolumeTestJSON-1333961364 tempest-AttachVolumeTestJSON-1333961364-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:58:59.538930 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:59:00.556646 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 43844. Jul 26 03:59:20.286976 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Took 0.57 seconds to select destinations for 3 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:59:20.306175 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.306584 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.363995 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.364400 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.407614 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.408011 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.448540 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.448945 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.449730 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.450125 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.466388 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Getting quotas for project d5d123eaad9a4d4f8efd8a0ec069fe53. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:59:20.470960 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Getting quotas for user 417c5f62c5504dce9ecdaa7dfd9e750c and project d5d123eaad9a4d4f8efd8a0ec069fe53. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:59:20.481730 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: f5833970-cb5a-4306-8e80-e0e6f6ee9fb3] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:59:20.482669 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.483071 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.490404 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: f5833970-cb5a-4306-8e80-e0e6f6ee9fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:59:20.491880 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.492315 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.521888 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.522288 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.533143 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: 7cfe8628-73fe-42fc-8b7d-8fcfb600975e] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:59:20.534335 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.534951 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.543366 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: 7cfe8628-73fe-42fc-8b7d-8fcfb600975e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:59:20.545870 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.546604 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.581176 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.581824 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.592933 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: bbec1574-9c31-4f77-8546-a6734bdc4278] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:59:20.594103 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.594550 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.607452 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] [instance: bbec1574-9c31-4f77-8546-a6734bdc4278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:59:20.608723 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.609129 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:20.642219 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:20.642624 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c6c75e0b-e497-4dde-98bb-8347c75bff35 tempest-ListServersNegativeTestJSON-513100546 tempest-ListServersNegativeTestJSON-513100546-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.054646 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 03:59:21.321858 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:59:21.340980 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.341384 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.389365 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.389762 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.390682 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.391342 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.432516 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:59:21.437389 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:59:21.463925 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: c8c31860-8242-40d3-b511-ebc6efeac38d] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:59:21.465136 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.465642 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.474390 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: c8c31860-8242-40d3-b511-ebc6efeac38d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='9eda5e36-c619-43f2-b0bf-8463110df811',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:59:21.476708 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.477297 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:21.523440 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:21.524467 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2e0e0fb5-94bf-4ecf-947a-397ebec216bc tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:22.105569 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 44214. Jul 26 03:59:25.434881 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 03:59:46.982461 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 03:59:47.001753 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.002152 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:47.049588 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.049986 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:47.050704 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.051094 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:47.065960 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Getting quotas for project eeca242577214f3dba62c9b63b6185de. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 03:59:47.070920 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Getting quotas for user 1645c6ed2e7b4056b1b2ac33bd0564f3 and project eeca242577214f3dba62c9b63b6185de. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 03:59:47.081053 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] [instance: 0da91f2a-7eeb-4947-be91-873248665bad] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 03:59:47.081943 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.082346 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:47.088841 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] [instance: 0da91f2a-7eeb-4947-be91-873248665bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 03:59:47.089992 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.090431 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 03:59:47.114766 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 03:59:47.115151 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-dc6be651-2ffe-472b-8f24-d681e973430b tempest-ServerAddressesTestJSON-1873745858 tempest-ServerAddressesTestJSON-1873745858-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.712660 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:00:03.732267 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.732717 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.782523 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.782923 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.783648 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.784042 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.798491 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Getting quotas for project 6bf48d7c9a824f0c8af82d1e4536e3c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:00:03.803589 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Getting quotas for user aa80f1984a8549e1ad2738608e41602e and project 6bf48d7c9a824f0c8af82d1e4536e3c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:00:03.814448 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] [instance: 028bb470-1987-4bf9-9632-b1fcbecd2d81] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:00:03.815495 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.815978 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.825363 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] [instance: 028bb470-1987-4bf9-9632-b1fcbecd2d81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:00:03.826838 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.827246 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:03.855822 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:03.856464 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-36e34a3c-5356-4265-a382-b7354f041758 tempest-ServerMetadataNegativeTestJSON-824495957 tempest-ServerMetadataNegativeTestJSON-824495957-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.825576 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:00:19.845905 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.846310 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.891506 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.891972 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.892735 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.893132 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.907995 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:00:19.913095 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:00:19.923467 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: bf25c838-9b73-41ae-94a7-330f15ef4dae] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:00:19.924412 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.924851 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.931410 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: bf25c838-9b73-41ae-94a7-330f15ef4dae] block_device_mapping [BlockDeviceMapping(attachment_id=7f0d5eed-55f0-4470-b832-b871e5b64151,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c514a09-9a86-4cbe-8d42-65058e1b4d32',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:00:19.932718 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.933122 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:19.965629 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:19.966375 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-d7f3fac7-8b11-4281-8819-4773fd8afbd3 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.242274 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:00:24.272465 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.273022 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.369324 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.369727 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.370448 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.371074 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.388183 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Getting quotas for project d0d5b20b35c74624b4d5ba015a7fc171. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:00:24.393282 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Getting quotas for user 5615edd8552f4765b1345483337791a4 and project d0d5b20b35c74624b4d5ba015a7fc171. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:00:24.405166 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] [instance: cbdbcd23-be40-4665-ae4e-263c9102e201] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:00:24.406615 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.407209 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.429157 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] [instance: cbdbcd23-be40-4665-ae4e-263c9102e201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:00:24.433478 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.435908 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:24.491603 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:24.492599 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-532883a8-9067-472a-8b22-dddcb0aa5fa8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.272860 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:00:25.307303 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.307954 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.375912 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.376372 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.377186 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.377588 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.397244 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Getting quotas for project d0d5b20b35c74624b4d5ba015a7fc171. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:00:25.402714 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Getting quotas for user 5615edd8552f4765b1345483337791a4 and project d0d5b20b35c74624b4d5ba015a7fc171. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:00:25.414757 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] [instance: a7db36d7-ebf0-4f72-85d8-7258d7cd3e34] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:00:25.415824 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.416343 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.428400 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] [instance: a7db36d7-ebf0-4f72-85d8-7258d7cd3e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:00:25.429806 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.430258 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:25.469927 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:25.472662 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-0b701a9f-dfc2-4af7-996f-cd32b818d7b8 tempest-ServerRescueNegativeTestJSON-1488896334 tempest-ServerRescueNegativeTestJSON-1488896334-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:33.228419 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:00:42.397283 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.30 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:00:42.417159 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.417658 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:42.476385 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.476820 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:42.477541 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.477928 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:42.492774 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:00:42.497384 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:00:42.507885 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 0d9d2b87-d088-4b9b-9c87-7d7dba20c06c] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:00:42.508822 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.509223 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:42.515306 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 0d9d2b87-d088-4b9b-9c87-7d7dba20c06c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='74ce5024-7381-464b-aab7-d413ee817e3d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:00:42.516479 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.516879 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:00:42.553809 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:00:42.554248 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0aa63b81-4c8e-43ce-bc08-6286ee003eaf tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.617978 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:01:52.637985 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.638304 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.685101 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.685821 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.686545 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.687121 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.717649 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:01:52.722119 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:01:52.733085 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 8a81da70-8b5f-4f0c-acb6-3d67ddef5958] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:01:52.734015 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.734421 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.742725 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: 8a81da70-8b5f-4f0c-acb6-3d67ddef5958] block_device_mapping [BlockDeviceMapping(attachment_id=c423a4ac-6a16-4aff-b43e-b88704fde85f,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a5c6a2c-56aa-43eb-a9a1-0873a55a2428',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:01:52.743871 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.744269 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:01:52.774771 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:01:52.775165 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-b4108c3d-159b-4b47-916c-1c812d43bc7c tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:00.556975 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:02:01.574790 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 46738. Jul 26 04:02:22.080333 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:02:23.095856 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 47102. Jul 26 04:02:39.511817 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Took 0.43 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:02:39.541915 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.542814 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:39.621755 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.622574 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:39.623547 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.624233 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:39.646149 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:02:39.652644 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for user c1144c78da014bb29236350561d29a12 and project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:02:39.676966 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: fe4f1e3f-b55f-4995-b710-1e69b18b9dbf] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:02:39.678787 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.680400 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:39.690582 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: fe4f1e3f-b55f-4995-b710-1e69b18b9dbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:02:39.692884 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.693469 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:39.750122 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:02:39.750883 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e69e647c-4801-4d8f-bee3-dcf932d66db4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:02:45.515399 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:03:22.821994 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:03:22.822570 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:03:22.822866 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:03:23.161148 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: fe4f1e3f-b55f-4995-b710-1e69b18b9dbf] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:03:23.506545 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Created allocations for migration 14737cc6-7d46-4515-b4da-f3556a17453a on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:03:23.878232 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: fe4f1e3f-b55f-4995-b710-1e69b18b9dbf] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:03:24.291289 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 1024, 'DISK_GB': 1}, 'generation': 179}}, 'project_id': 'b248b60c2e5e44fa8c87deee1ca56aab', 'user_id': 'c1144c78da014bb29236350561d29a12', 'consumer_generation': 1} on consumer fe4f1e3f-b55f-4995-b710-1e69b18b9dbf {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:03:24.439034 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Created allocations for instance fe4f1e3f-b55f-4995-b710-1e69b18b9dbf on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:03:24.489976 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:03:24.491377 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: fe4f1e3f-b55f-4995-b710-1e69b18b9dbf] Setting instance to ACTIVE state. Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-eea9412d-32b8-47b9-a60b-fc8e7fb346d0 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:03:24.578787 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:03:24.580665 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:03:24.582625 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:03:24.582625 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:03:53.245431 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:04:20.667029 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:04:20.722819 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.723493 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:20.799863 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.799863 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:20.800747 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.801239 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:20.817943 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:04:20.823900 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:04:20.850468 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: f82901d3-553d-441b-bee6-30c49127e6d1] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:04:20.852312 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.852910 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:20.868661 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: f82901d3-553d-441b-bee6-30c49127e6d1] block_device_mapping [BlockDeviceMapping(attachment_id=4445f896-1241-4b47-9ebc-b0e3a4d17683,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5a5c6a2c-56aa-43eb-a9a1-0873a55a2428',volume_size=1,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:04:20.871137 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.871678 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:20.930879 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:04:20.931831 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-acbaab5b-262d-45e9-8b4d-ccd37f815659 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:04:37.309557 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:05:01.575924 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:05:02.598512 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 49994. Jul 26 04:05:23.098306 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:05:24.126874 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 50332. Jul 26 04:05:44.967929 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:05:44.990040 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:44.990727 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:45.053631 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:45.054034 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:45.054765 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:45.055154 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:45.071851 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Getting quotas for project 838cca8eafdb4944aab7141b92622771. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:05:45.077200 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Getting quotas for user 7d72c3eab08d434c8a9ea4abd1b2885b and project 838cca8eafdb4944aab7141b92622771. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:05:45.089216 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] [instance: ae35063b-2ef8-44f0-818d-778df4f3b4fe] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:05:45.090230 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:45.090729 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:45.098721 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] [instance: ae35063b-2ef8-44f0-818d-778df4f3b4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:05:45.099961 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:45.100364 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:45.129150 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:45.129660 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e5f294cf-7432-46f9-910c-ed4ba4169d64 tempest-TestServerBasicOps-214511517 tempest-TestServerBasicOps-214511517-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.224760 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:05:51.242840 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.243250 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.292034 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.292436 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.293184 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.293579 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.308286 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Getting quotas for project 49e82181d0734a5c9c17ecca7fa61087. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:05:51.312859 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Getting quotas for user a988dcf3a6d5474ba00b9904ed5e82bb and project 49e82181d0734a5c9c17ecca7fa61087. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:05:51.322934 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] [instance: 51b5c297-9afe-48c9-addf-fe5e210a1e48] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:05:51.323819 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.324219 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.330846 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] [instance: 51b5c297-9afe-48c9-addf-fe5e210a1e48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:05:51.332000 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.332410 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:05:51.356828 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:05:51.357250 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-7e6f038b-910b-4911-9f5e-b0bdeadd6502 tempest-VolumesBackupsTest-1451665620 tempest-VolumesBackupsTest-1451665620-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:05.539392 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:06:24.266866 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Took 0.22 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:06:24.287924 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.288333 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:24.331926 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.332336 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:24.333103 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.333501 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:24.348148 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:06:24.352606 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Getting quotas for user f631f61cc3464133b98442388931d286 and project 78dcaebd776242e1a8a43fa813f1cc87. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:06:24.363624 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: feb47f62-95df-4803-8989-77f22fb2075e] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:06:24.364972 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.365373 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:24.371646 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] [instance: feb47f62-95df-4803-8989-77f22fb2075e] block_device_mapping [BlockDeviceMapping(attachment_id=68256d63-3498-40ce-a1b4-e660054212b3,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51a5ecce-c899-4393-9e64-f313088ab856',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:06:24.373045 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.373490 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:06:24.397786 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:06:24.398300 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-538f09e0-7cde-4d5b-b645-7093ed439891 tempest-TestVolumeBootPattern-343567644 tempest-TestVolumeBootPattern-343567644-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:07:13.270250 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:07:53.146088 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:07:53.218834 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:07:54.163711 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 52632. Jul 26 04:07:54.969048 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:08:02.600270 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:08:03.616522 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 52722. Jul 26 04:08:17.335690 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:08:18.358713 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 52898. Jul 26 04:08:24.126195 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:08:25.144048 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 53042. Jul 26 04:08:55.978039 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:08:56.997372 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 53538. Jul 26 04:09:17.376427 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:09:18.400057 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 54204. Jul 26 04:09:25.555663 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:09:36.027659 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:09:37.343489 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:09:38.185569 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Took 0.47 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:09:38.212372 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.212839 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:09:38.304678 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.305004 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:09:38.307568 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.308014 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:09:38.328834 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:09:38.336404 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for user c1144c78da014bb29236350561d29a12 and project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:09:38.352149 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: c60de8f6-8c23-4e6b-917e-761c3c6ff447] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:09:38.353377 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.353884 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:09:38.363066 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: c60de8f6-8c23-4e6b-917e-761c3c6ff447] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:09:38.367023 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.367434 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:09:38.417286 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:09:38.417697 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-d3d13942-6f53-4c93-b3d4-b97c0ba705b5 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:19.735291 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:10:19.735883 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:19.736188 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:20.187876 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Created allocations for migration 57829fb5-cf63-4200-b8a9-98a8d811c676 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:10:20.497106 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: c60de8f6-8c23-4e6b-917e-761c3c6ff447] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while live migrating {{(pid=99992) _get_request_spec_for_select_destinations /opt/stack/nova/nova/conductor/tasks/live_migrate.py:494}} Jul 26 04:10:20.771317 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lazy-loading 'resources' on Instance uuid c60de8f6-8c23-4e6b-917e-761c3c6ff447 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 04:10:20.776827 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] Lazy-loading 'pci_requests' on Instance uuid c60de8f6-8c23-4e6b-917e-761c3c6ff447 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 04:10:21.194636 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.live_migrate [None req-af5b2394-8cf6-4499-aa82-3ef5f9282b57 tempest-TestNetworkAdvancedServerOps-158592751 tempest-TestNetworkAdvancedServerOps-158592751-project-admin] [instance: c60de8f6-8c23-4e6b-917e-761c3c6ff447] Start binding ports on destination host: n-h2-802225-1 {{(pid=99992) _bind_ports_on_destination /opt/stack/nova/nova/conductor/tasks/live_migrate.py:389}} Jul 26 04:10:27.606968 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:10:27.626205 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.626609 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:27.677328 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.677946 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:27.678678 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.679082 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:27.695599 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Getting quotas for project 90316a15f8de4a8dabad7fea0781eb96. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:10:27.700880 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Getting quotas for user c0339a6ca0154838a5ed6efb0f2de394 and project 90316a15f8de4a8dabad7fea0781eb96. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:10:27.712007 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] [instance: ec429773-1596-4f51-8ba5-457cf4697214] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:10:27.712599 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.utils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Re-scheduling is disabled due to forcing a host (['n-h1-802225-1']) and/or node ([]) {{(pid=99991) populate_retry /opt/stack/nova/nova/scheduler/utils.py:953}} Jul 26 04:10:27.713378 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.713777 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:27.725336 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] [instance: ec429773-1596-4f51-8ba5-457cf4697214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:10:27.726886 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.727488 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:27.762231 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:27.763415 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-0ca23549-3a59-4ba1-a47c-0be2394a7269 tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:33.289698 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:10:38.178925 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:10:38.197241 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.197652 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:38.240843 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.241268 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:38.241986 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.242377 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:38.262734 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Getting quotas for project 90316a15f8de4a8dabad7fea0781eb96. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:10:38.267178 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Getting quotas for user c0339a6ca0154838a5ed6efb0f2de394 and project 90316a15f8de4a8dabad7fea0781eb96. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:10:38.279952 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] [instance: 71e510d5-af2c-4adf-abbc-9989364275b7] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:10:38.280580 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.utils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Re-scheduling is disabled due to forcing a host (['n-h2-802225-1']) and/or node ([]) {{(pid=99992) populate_retry /opt/stack/nova/nova/scheduler/utils.py:953}} Jul 26 04:10:38.281395 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.281923 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:38.289930 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] [instance: 71e510d5-af2c-4adf-abbc-9989364275b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:10:38.291196 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.291604 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:38.338812 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:38.339624 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-c48defff-18ef-499a-969a-73eaea13180e tempest-TestServerMultinode-1398048888 tempest-TestServerMultinode-1398048888-project-admin] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:57.965760 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Took 0.36 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:10:58.029851 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.032490 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:58.146490 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.147148 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:58.148805 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.149834 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:58.172724 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:10:58.177762 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Getting quotas for user c1144c78da014bb29236350561d29a12 and project b248b60c2e5e44fa8c87deee1ca56aab. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:10:58.206344 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: c97c5966-2945-4cd3-8f68-4c4623100075] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:10:58.209908 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.210320 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:58.224628 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: c97c5966-2945-4cd3-8f68-4c4623100075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:10:58.237479 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.241539 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:10:58.327454 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:10:58.328197 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-fdaa6017-0406-4232-b7e8-490f6ffc7ac4 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:11:25.148105 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:11:26.167293 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 56150. Jul 26 04:11:41.385855 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8fd4541b-55b4-4fbb-815f-3dc8cc3c53e6 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method rebuild_instance {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:11:41.386404 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8fd4541b-55b4-4fbb-815f-3dc8cc3c53e6 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:11:41.386734 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8fd4541b-55b4-4fbb-815f-3dc8cc3c53e6 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:11:41.401606 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8fd4541b-55b4-4fbb-815f-3dc8cc3c53e6 tempest-TestNetworkAdvancedServerOps-885164936 tempest-TestNetworkAdvancedServerOps-885164936-project] [instance: c97c5966-2945-4cd3-8f68-4c4623100075] No migration record for the rebuild/evacuate request. {{(pid=99992) rebuild_instance /opt/stack/nova/nova/conductor/manager.py:1101}} Jul 26 04:12:44.097318 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:12:44.118177 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.118659 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:44.175276 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.175684 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:44.176417 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.176842 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:44.192268 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Getting quotas for project a7919226b3504b4e817b89fb140cf032. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:12:44.196728 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Getting quotas for user 2ed2013e355a4356ad76d093a8f7ef24 and project a7919226b3504b4e817b89fb140cf032. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:12:44.207905 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] [instance: c1fbdfe6-c452-4a01-81d1-39af5db5e15e] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:12:44.208895 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.209305 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:44.217500 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] [instance: c1fbdfe6-c452-4a01-81d1-39af5db5e15e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:12:44.218786 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.219363 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:44.251864 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:12:44.252362 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-e917124e-8254-40ca-8a3b-66644000c4fa tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:12:56.997152 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:12:58.014418 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 57208. Jul 26 04:13:03.621074 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:13:04.638863 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 57304. Jul 26 04:13:08.854872 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:13:08.874907 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.875304 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:08.924170 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.924613 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:08.925393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.925784 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:08.940303 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Getting quotas for project fd368a0f25804a2dbdd5ce6e7b2867d2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:13:08.944666 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Getting quotas for user cd0e10ce7ed64689b39454316ee99d54 and project fd368a0f25804a2dbdd5ce6e7b2867d2. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:13:08.955557 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] [instance: 7b6e7760-9427-4632-a487-e46a27b8f8ec] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:13:08.956468 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.956865 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:08.962674 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] [instance: 7b6e7760-9427-4632-a487-e46a27b8f8ec] block_device_mapping [BlockDeviceMapping(attachment_id=d54e0096-3790-4178-8e46-635b4b8e594e,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='484801a9-ffe8-4714-81f0-72401588086e',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:13:08.963834 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.964229 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:08.988377 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:08.988808 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-424f62e7-f3e1-4d75-9227-f239072a8b39 tempest-TestVolumeBackupRestore-1519514501 tempest-TestVolumeBackupRestore-1519514501-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:35.994670 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Took 0.28 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:13:36.014857 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.015265 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:36.061233 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.061653 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:36.062298 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.062746 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:36.078217 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Getting quotas for project a7919226b3504b4e817b89fb140cf032. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:13:36.082990 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Getting quotas for user 2ed2013e355a4356ad76d093a8f7ef24 and project a7919226b3504b4e817b89fb140cf032. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:13:36.094748 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] [instance: d18bd1d8-f614-4b14-9b55-a79ea0ab724a] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:13:36.095742 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.096189 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:36.103898 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] [instance: d18bd1d8-f614-4b14-9b55-a79ea0ab724a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:13:36.105233 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.105636 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:36.133632 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:13:36.134152 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-1fd3c5e3-231f-4d90-a462-d44b89f6f92f tempest-TestSecurityGroupsBasicOps-359513367 tempest-TestSecurityGroupsBasicOps-359513367-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:13:53.306053 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:14:25.573794 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:14:26.167103 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:14:27.183360 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58090. Jul 26 04:14:31.448933 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:14:31.466404 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.466824 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:31.514404 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.514799 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:31.515515 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.515904 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:31.530317 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Getting quotas for project f58a60f8f223452ebb8c61191ff4ed77. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:14:31.534588 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Getting quotas for user 56fac0ea777243659fe6e746f2a77a29 and project f58a60f8f223452ebb8c61191ff4ed77. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:14:31.545285 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] [instance: f43f1d4c-e25d-417d-8ce1-3480c3a40190] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:14:31.546160 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.546549 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:31.552431 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] [instance: f43f1d4c-e25d-417d-8ce1-3480c3a40190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:14:31.553570 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.553965 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:31.578033 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:31.578495 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-58bf64c1-2092-42b4-a26d-e2c5a40db9c4 tempest-ServersAdminNegativeTestJSON-561572044 tempest-ServersAdminNegativeTestJSON-561572044-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.336349 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:14:46.355051 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.355452 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.402965 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.403361 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.404089 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.404508 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.418967 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Getting quotas for project 70a9de01021b45e687325728d9b40dd8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:14:46.423352 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Getting quotas for user af7c90f2d6084abda2f3fa53f7bd0a9b and project 70a9de01021b45e687325728d9b40dd8. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:14:46.434104 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] [instance: 94d86ba8-2fa8-48b8-8a02-b99746d0ff22] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:14:46.434979 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.435381 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.441915 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] [instance: 94d86ba8-2fa8-48b8-8a02-b99746d0ff22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:14:46.443055 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.443453 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:46.468104 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:46.468546 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-da320400-42fc-4e38-8c01-60a3670e7e04 tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:55.831357 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:14:55.831836 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:14:55.832251 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:14:55.958693 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] [instance: 94d86ba8-2fa8-48b8-8a02-b99746d0ff22] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:14:56.223973 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Created allocations for migration 29cbf983-ee26-4016-91f6-c24ecf974bdb on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:14:56.417384 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] [instance: 94d86ba8-2fa8-48b8-8a02-b99746d0ff22] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:14:56.573884 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 196}}, 'project_id': '70a9de01021b45e687325728d9b40dd8', 'user_id': 'af7c90f2d6084abda2f3fa53f7bd0a9b', 'consumer_generation': 1} on consumer 94d86ba8-2fa8-48b8-8a02-b99746d0ff22 {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:14:56.644786 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Created allocations for instance 94d86ba8-2fa8-48b8-8a02-b99746d0ff22 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:14:56.670866 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:14:56.671991 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] [instance: 94d86ba8-2fa8-48b8-8a02-b99746d0ff22] Setting instance to ACTIVE state. Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-1fac7687-5fd6-46d5-8bde-ef277697f5ef tempest-DeleteServersTestJSON-1585465052 tempest-DeleteServersTestJSON-1585465052-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:14:56.729945 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:14:56.731175 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:14:56.732731 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:14:56.732731 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:16:04.640087 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:16:05.656236 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58472. Jul 26 04:16:54.170186 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:16:55.186700 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58568. Jul 26 04:16:58.015991 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:16:59.033479 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58578. Jul 26 04:17:13.323370 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:17:18.360271 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:17:18.399037 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:17:19.380311 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58620. Jul 26 04:17:19.418491 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58622. Jul 26 04:17:27.184829 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:17:28.199781 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58638. Jul 26 04:17:45.590464 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:17:53.242769 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:17:54.991833 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:17:56.072573 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:19:05.657011 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:19:06.672870 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58872. Jul 26 04:19:37.373246 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:19:55.188196 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:19:56.205299 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58982. Jul 26 04:19:59.035141 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:20:00.051681 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 58992. Jul 26 04:20:19.376061 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:20:19.414972 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:20:20.401199 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59034. Jul 26 04:20:20.435097 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59036. Jul 26 04:20:28.200708 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:20:29.217532 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59056. Jul 26 04:20:33.339578 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:21:02.810353 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [89281be5-7cba-4b5d-87f4-af79574e2c05] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 04:21:03.825532 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [89281be5-7cba-4b5d-87f4-af79574e2c05] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59188. Jul 26 04:21:05.605893 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:21:06.301667 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Took 3.50 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:21:06.319497 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.319897 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.385601 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.385915 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.386626 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.387012 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.401379 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Getting quotas for project ea1143100b714db694a902ea17646b46. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:21:06.405629 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Getting quotas for user 46c768ffa391487697b4bccea6b71fd4 and project ea1143100b714db694a902ea17646b46. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:21:06.416141 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: be598a7a-df61-40c0-bf87-dad07265aeb8] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:21:06.417045 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.417441 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.424068 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: be598a7a-df61-40c0-bf87-dad07265aeb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:21:06.425232 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.425630 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.450048 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:06.450451 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:06.461013 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [5bec7749-908e-4152-b710-0bde5ccf1fe4] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 04:21:07.475184 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0d9c9a5-5079-4304-8f58-ec70e1d52c92 tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [5bec7749-908e-4152-b710-0bde5ccf1fe4] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59220. Jul 26 04:21:16.089063 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:21:16.136575 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:21:16.137063 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:21:16.137648 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:21:16.274252 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: be598a7a-df61-40c0-bf87-dad07265aeb8] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:21:16.536779 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Created allocations for migration f7d8f9e2-ff32-4156-b2b1-b3383be8a79d on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:22:06.673876 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:22:07.689879 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59384. Jul 26 04:22:16.773181 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Created allocations for instance be598a7a-df61-40c0-bf87-dad07265aeb8 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:22:16.807637 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Failed to compute_task_migrate_server: Timed out waiting for a reply to message ID 1107adca71fa4d04a12d11d32f889d0a: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1107adca71fa4d04a12d11d32f889d0a Jul 26 04:22:16.808925 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: be598a7a-df61-40c0-bf87-dad07265aeb8] Setting instance to ACTIVE state.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1107adca71fa4d04a12d11d32f889d0a Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-24709058-f3a8-40c2-8e62-4b7b65448f9e tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Exception during message handling: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1107adca71fa4d04a12d11d32f889d0a Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 433, in get Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._queues[msg_id].get(block=True, timeout=timeout) Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 322, in get Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return waiter.wait() Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/eventlet/queue.py", line 141, in wait Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return get_hub().switch() Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 313, in switch Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self.greenlet.switch() Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server _queue.Empty Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:22:16.886843 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:22:16.888185 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 286, in _execute Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server selection = self._schedule() Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 335, in _schedule Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server selection_lists = self.query_client.select_destinations( Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/client/query.py", line 41, in select_destinations Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self.scheduler_rpcapi.select_destinations(context, spec_obj, Jul 26 04:22:16.889380 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/scheduler/rpcapi.py", line 160, in select_destinations Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return cctxt.call(ctxt, 'select_destinations', **msg_args) Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/client.py", line 175, in call Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/transport.py", line 123, in _send Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 680, in send Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 669, in _send Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = self._waiter.wait(msg_id, timeout, Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 559, in wait Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server message = self.waiters.get(msg_id, timeout=timeout) Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 435, in get Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise oslo_messaging.MessagingTimeout( Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1107adca71fa4d04a12d11d32f889d0a Jul 26 04:22:16.890590 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:22:57.390071 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:23:00.052595 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:23:01.068204 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59498. Jul 26 04:23:20.394600 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:23:20.431384 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:23:21.417545 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59540. Jul 26 04:23:21.452358 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59542. Jul 26 04:23:29.217728 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:23:30.234635 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59560. Jul 26 04:23:53.356770 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:23:56.208468 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:23:57.224649 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59622. Jul 26 04:24:36.106093 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:25:07.691170 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:25:08.706410 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59760. Jul 26 04:26:01.068805 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:26:02.085478 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59870. Jul 26 04:26:13.263893 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:26:15.012614 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:26:17.406087 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:26:21.414866 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:26:21.449562 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:26:22.435266 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59924. Jul 26 04:26:22.470395 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59926. Jul 26 04:26:30.235944 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:26:31.251919 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 59948. Jul 26 04:26:57.225132 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:26:58.241213 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60002. Jul 26 04:27:13.374371 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:27:18.066460 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Took 0.33 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:27:18.087657 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.088107 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:18.133729 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.134142 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:18.134876 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.135278 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:18.150157 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Getting quotas for project ea1143100b714db694a902ea17646b46. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:27:18.154570 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Getting quotas for user 46c768ffa391487697b4bccea6b71fd4 and project ea1143100b714db694a902ea17646b46. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:27:18.164872 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:27:18.165763 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.166171 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:18.172568 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:27:18.173741 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.174143 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:18.198936 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:18.199348 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5719940d-30ac-488e-8597-8117010cc6ef tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:27.443706 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:27:27.444177 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:27:27.444611 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:27:27.600737 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:27:27.855505 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Created allocations for migration 1fa8d38e-7e42-44a8-8de2-7f850398629a on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:27:28.055813 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:27:28.209876 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 201}}, 'project_id': 'ea1143100b714db694a902ea17646b46', 'user_id': '46c768ffa391487697b4bccea6b71fd4', 'consumer_generation': 1} on consumer 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:27:28.284828 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Created allocations for instance 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:27:28.311212 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:27:28.312344 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [instance: 0b6f532d-7e9a-433b-8eb2-d1b0397ebdec] Setting instance to ACTIVE state. Jul 26 04:27:28.344298 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [ea52ab00-75f4-4d4c-bad9-bacf04f080d7] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 04:27:29.360166 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] [ea52ab00-75f4-4d4c-bad9-bacf04f080d7] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60178. Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-a67523a6-ad68-4dca-bfa4-2e9e803c803f tempest-ServerDiskConfigTestJSON-1954525437 tempest-ServerDiskConfigTestJSON-1954525437-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:27:29.389414 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:27:29.390647 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:27:29.392035 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:27:29.392035 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:28:08.707804 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:28:09.723135 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60266. Jul 26 04:29:22.432543 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:29:23.452659 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60422. Jul 26 04:29:31.252727 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:29:32.270320 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60448. Jul 26 04:29:36.124349 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:29:37.422987 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:29:58.242018 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:29:59.259033 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60512. Jul 26 04:30:02.087071 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:30:03.103409 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60522. Jul 26 04:30:22.467029 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:30:23.487625 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60560. Jul 26 04:30:33.390395 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:31:09.724757 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:31:10.741084 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60664. Jul 26 04:32:23.449740 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:32:24.470954 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60794. Jul 26 04:32:32.270666 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:32:33.285876 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60812. Jul 26 04:32:45.629966 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:32:53.284053 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:32:55.032040 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:32:56.140277 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:32:57.439122 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:32:59.258997 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:33:00.274577 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60886. Jul 26 04:33:03.104169 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:33:04.119830 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60894. Jul 26 04:33:23.484064 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:33:24.506304 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 60938. Jul 26 04:33:39.539945 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Took 0.50 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:33:39.565409 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.565871 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:39.625447 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.625937 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:39.626676 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.627085 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:39.646428 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:33:39.651387 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for user fa2c77adc87947999f1c993b5c92e5a3 and project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:33:39.665991 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 0644f44c-27ea-45e3-96ec-b60552ccc918] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:33:39.667217 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.667623 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:39.674261 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 0644f44c-27ea-45e3-96ec-b60552ccc918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:33:39.675618 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.676022 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:39.703656 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:33:39.704061 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-2d2e9874-2b73-4193-8f4f-807481919adc tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:33:53.407420 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:34:10.741978 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:34:11.760138 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 32912. Jul 26 04:35:25.922834 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:35:25.923466 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:35:25.923725 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:35:26.086933 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 0644f44c-27ea-45e3-96ec-b60552ccc918] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:35:26.362445 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for migration 07552941-6239-4abd-b9fe-cedbcb13d84f on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:35:26.559308 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 0644f44c-27ea-45e3-96ec-b60552ccc918] Calling prep_resize with selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"c88f8435-9d4d-41fb-83fa-eae02604b075": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c88f8435-9d4d-41fb-83fa-eae02604b075"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=c88f8435-9d4d-41fb-83fa-eae02604b075,limits=SchedulerLimits,nodename='n-h1-802225-1',service_host='n-h1-802225-1')] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:35:26.716527 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Overwriting current allocation {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 185}}, 'project_id': 'c79b662e4a864ef0b6fd74a9d66261c5', 'user_id': 'fa2c77adc87947999f1c993b5c92e5a3', 'consumer_generation': 1} on consumer 0644f44c-27ea-45e3-96ec-b60552ccc918 {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:35:26.786069 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for instance 0644f44c-27ea-45e3-96ec-b60552ccc918 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:35:26.814413 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:35:26.815550 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 0644f44c-27ea-45e3-96ec-b60552ccc918] Setting instance to ACTIVE state. Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-698cf132-0c7d-462f-9341-54261ca551dd tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:35:26.877075 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:35:26.878301 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:35:26.879678 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:35:26.879678 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:35:33.286728 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:35:34.303265 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33126. Jul 26 04:36:00.274929 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:36:01.292497 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33180. Jul 26 04:36:13.299679 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:36:15.048121 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:36:17.455166 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:36:24.468450 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:36:25.488779 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33234. Jul 26 04:37:11.759712 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:37:12.775177 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33322. Jul 26 04:37:13.428543 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:37:45.648513 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:38:04.124349 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:38:05.139845 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33424. Jul 26 04:38:24.504989 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:38:25.526617 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33468. Jul 26 04:38:34.305151 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:38:35.319957 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33486. Jul 26 04:39:01.292845 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:39:02.308966 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33542. Jul 26 04:39:25.486179 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:39:26.507261 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33586. Jul 26 04:39:33.316949 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:39:35.064120 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:39:37.471782 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:40:12.777820 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:40:13.793981 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33688. Jul 26 04:40:33.441039 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:41:05.141656 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:41:05.665359 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:41:06.158125 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33794. Jul 26 04:41:16.160782 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:41:25.523756 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:41:26.544419 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33840. Jul 26 04:41:30.568959 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:41:30.587634 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.588046 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:30.630520 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.630925 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:30.631649 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.632043 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:30.646399 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:41:30.650646 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for user fa2c77adc87947999f1c993b5c92e5a3 and project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:41:30.660987 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: f9a3c5c1-3aa3-476d-b20f-1cc899dc4064] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:41:30.661873 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.662277 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:30.669998 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: f9a3c5c1-3aa3-476d-b20f-1cc899dc4064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:41:30.671231 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.671713 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:30.695769 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:41:30.696206 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-5ce7cc4c-ecdc-4fb0-a9da-c563a724174d tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:41:35.321012 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:41:36.337341 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 33916. Jul 26 04:42:57.487987 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:43:13.794837 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:43:14.810569 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34128. Jul 26 04:43:26.554040 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:43:26.554596 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:43:26.554923 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:43:26.710959 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: f9a3c5c1-3aa3-476d-b20f-1cc899dc4064] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99992) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:43:26.965098 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for migration 568dfb94-1172-431e-899e-69b4fcc014ef on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:43:27.167624 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: f9a3c5c1-3aa3-476d-b20f-1cc899dc4064] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99992) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:43:27.319977 n-d-802225-1 nova-conductor[99992]: DEBUG nova.scheduler.client.report [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 206}}, 'project_id': 'c79b662e4a864ef0b6fd74a9d66261c5', 'user_id': 'fa2c77adc87947999f1c993b5c92e5a3', 'consumer_generation': 1} on consumer f9a3c5c1-3aa3-476d-b20f-1cc899dc4064 {{(pid=99992) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:43:27.388339 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.tasks.migrate [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for instance f9a3c5c1-3aa3-476d-b20f-1cc899dc4064 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99992) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:43:27.418267 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:43:27.419398 n-d-802225-1 nova-conductor[99992]: WARNING nova.scheduler.utils [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: f9a3c5c1-3aa3-476d-b20f-1cc899dc4064] Setting instance to STOPPED state. Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server [None req-e0d1b370-c2a7-4736-b14c-50aab5c2ddd5 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:43:27.477173 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:43:27.478516 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:43:27.479816 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:43:27.479816 n-d-802225-1 nova-conductor[99992]: ERROR oslo_messaging.rpc.server Jul 26 04:43:53.457956 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:44:02.313320 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:44:03.328603 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34266. Jul 26 04:44:26.507919 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:44:27.528194 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34308. Jul 26 04:44:33.334332 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:44:35.081775 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:44:36.337728 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:44:37.353672 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34332. Jul 26 04:46:05.683910 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:46:06.161895 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:46:07.177917 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34512. Jul 26 04:46:14.811894 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:46:15.827850 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34542. Jul 26 04:46:16.178832 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:46:17.503542 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:46:26.543666 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:46:27.565576 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34572. Jul 26 04:47:03.330121 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:47:04.346690 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34642. Jul 26 04:47:13.473904 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:47:27.525126 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:47:28.546656 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34688. Jul 26 04:47:37.354766 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:47:38.370229 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34706. Jul 26 04:47:53.350423 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:47:55.097682 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:49:07.179055 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:49:08.195210 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34882. Jul 26 04:49:15.828853 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:49:16.846079 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34898. Jul 26 04:49:25.699564 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:49:27.562805 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:49:28.584105 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 34928. Jul 26 04:49:36.194086 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:49:37.518861 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:50:04.348004 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:50:05.364448 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35014. Jul 26 04:50:28.543555 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:50:29.564710 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35058. Jul 26 04:50:33.490591 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:50:38.372792 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:50:39.389691 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35080. Jul 26 04:51:13.366763 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:51:15.113634 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:52:08.197523 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:52:09.213750 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35254. Jul 26 04:52:16.847052 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:52:17.865425 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35276. Jul 26 04:52:28.579962 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:52:29.600524 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35302. Jul 26 04:52:45.716354 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:52:56.211990 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:52:57.535624 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:53:05.365849 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:53:06.381711 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35386. Jul 26 04:53:29.559978 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:53:30.580527 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35432. Jul 26 04:53:39.390303 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:53:40.406203 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35452. Jul 26 04:53:53.507257 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:54:33.382956 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:54:35.130425 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:55:09.214746 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:55:10.233301 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35626. Jul 26 04:55:17.866478 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:55:18.882318 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35646. Jul 26 04:55:29.597208 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:55:30.620408 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35712. Jul 26 04:55:30.632068 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 04:55:30.650514 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.650927 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:55:30.697852 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.699012 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:55:30.700570 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.701018 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:55:30.715326 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 04:55:30.720393 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for user fa2c77adc87947999f1c993b5c92e5a3 and project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 04:55:30.730522 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 30c3793e-1bcc-4c56-86d7-7e29836a5705] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 04:55:30.731404 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.731802 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:55:30.738694 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 30c3793e-1bcc-4c56-86d7-7e29836a5705] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 04:55:30.740192 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.740646 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:55:30.764871 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:55:30.765276 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f9cd7e32-de44-4013-9240-7ba35d882843 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:56:05.732688 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:56:16.228606 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:56:17.552179 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:56:40.407506 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:56:41.424187 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 35872. Jul 26 04:57:13.543966 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:57:16.778817 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 04:57:16.779475 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 04:57:16.779832 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 04:57:17.032269 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 30c3793e-1bcc-4c56-86d7-7e29836a5705] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99991) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 04:57:17.307877 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for migration 997cbb8f-5988-45cb-9d77-dedcc111664c on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 04:57:17.500928 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 30c3793e-1bcc-4c56-86d7-7e29836a5705] Calling prep_resize with selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"89921da4-8192-4609-a428-d99fff8e0658": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["89921da4-8192-4609-a428-d99fff8e0658"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=89921da4-8192-4609-a428-d99fff8e0658,limits=SchedulerLimits,nodename='n-h2-802225-1',service_host='n-h2-802225-1')] {{(pid=99991) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 04:57:17.653366 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.client.report [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Overwriting current allocation {'allocations': {'c88f8435-9d4d-41fb-83fa-eae02604b075': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 207}}, 'project_id': 'c79b662e4a864ef0b6fd74a9d66261c5', 'user_id': 'fa2c77adc87947999f1c993b5c92e5a3', 'consumer_generation': 1} on consumer 30c3793e-1bcc-4c56-86d7-7e29836a5705 {{(pid=99991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 04:57:17.721350 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for instance 30c3793e-1bcc-4c56-86d7-7e29836a5705 on 89921da4-8192-4609-a428-d99fff8e0658 {{(pid=99991) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 04:57:17.748962 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:57:17.750091 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: 30c3793e-1bcc-4c56-86d7-7e29836a5705] Setting instance to ACTIVE state. Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server [None req-92d7c1aa-993c-4bc4-ae57-f8de544a8161 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 04:57:17.814973 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 04:57:17.816851 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 04:57:17.818143 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 04:57:17.818143 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Jul 26 04:57:55.147433 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:58:10.233182 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:58:11.249370 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36098. Jul 26 04:58:18.882740 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:58:19.899052 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36114. Jul 26 04:58:30.615972 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:58:31.637015 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36138. Jul 26 04:59:25.768189 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:59:30.580401 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 04:59:31.606906 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36258. Jul 26 04:59:33.400457 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:59:36.248224 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:59:37.569036 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 04:59:41.424719 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 04:59:42.441315 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36286. Jul 26 05:00:06.387605 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:00:07.404897 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36336. Jul 26 05:00:33.559741 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:01:11.249812 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:01:12.266008 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36458. Jul 26 05:01:15.163492 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:01:19.899696 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:01:20.916311 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36478. Jul 26 05:01:31.632665 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:01:32.654118 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36502. Jul 26 05:02:31.597899 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:02:32.620608 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36616. Jul 26 05:02:42.441766 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:02:43.457879 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36636. Jul 26 05:02:45.784699 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:02:53.417026 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:02:56.264959 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:02:57.585982 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:03:07.405035 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:03:08.420934 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36706. Jul 26 05:03:21.663727 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:03:21.682177 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.682602 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:21.723982 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.724376 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:21.725116 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.725499 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:21.741749 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:03:21.746640 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Getting quotas for user fa2c77adc87947999f1c993b5c92e5a3 and project c79b662e4a864ef0b6fd74a9d66261c5. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:03:21.756786 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: a25c04f7-908f-4192-8127-29dfa2096cea] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:03:21.757670 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.758058 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:21.764490 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: a25c04f7-908f-4192-8127-29dfa2096cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:03:21.765626 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.766022 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:21.789932 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:03:21.790288 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9628d867-4bbd-44fc-a076-e27b8aa8bd99 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:03:53.576219 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:04:20.917417 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:04:21.933628 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 36912. Jul 26 05:04:35.179885 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:05:19.472867 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 05:05:19.473459 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:05:19.473750 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:05:19.619789 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: a25c04f7-908f-4192-8127-29dfa2096cea] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99991) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 05:05:19.878932 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for migration 08485885-bc21-462c-abe1-3b957f62a297 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 05:05:20.085614 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: a25c04f7-908f-4192-8127-29dfa2096cea] Calling prep_resize with selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"c88f8435-9d4d-41fb-83fa-eae02604b075": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c88f8435-9d4d-41fb-83fa-eae02604b075"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=c88f8435-9d4d-41fb-83fa-eae02604b075,limits=SchedulerLimits,nodename='n-h1-802225-1',service_host='n-h1-802225-1')] {{(pid=99991) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 05:05:20.256226 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.client.report [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Overwriting current allocation {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 194}}, 'project_id': 'c79b662e4a864ef0b6fd74a9d66261c5', 'user_id': 'fa2c77adc87947999f1c993b5c92e5a3', 'consumer_generation': 1} on consumer a25c04f7-908f-4192-8127-29dfa2096cea {{(pid=99991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 05:05:20.326206 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Created allocations for instance a25c04f7-908f-4192-8127-29dfa2096cea on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 05:05:20.355847 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:05:20.357002 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] [instance: a25c04f7-908f-4192-8127-29dfa2096cea] Setting instance to ACTIVE state. Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server [None req-b7b99992-130e-498d-abb3-92f0bf6f9047 tempest-ServerActionsTestJSON-522143939 tempest-ServerActionsTestJSON-522143939-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 05:05:20.414763 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 05:05:20.416791 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 05:05:20.418254 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:05:20.418254 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Jul 26 05:05:32.651768 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:05:33.671953 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37126. Jul 26 05:05:43.458990 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:05:44.475597 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37148. Jul 26 05:06:05.800884 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:06:12.269122 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:06:13.285505 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37204. Jul 26 05:06:16.281566 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:06:17.602520 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:07:21.933820 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:07:22.949094 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37340. Jul 26 05:07:32.617996 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:07:33.639639 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37362. Jul 26 05:07:53.433879 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:07:55.196232 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:08:08.424054 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:08:09.440129 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37442. Jul 26 05:08:33.667992 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:08:34.689311 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37492. Jul 26 05:08:44.476923 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:08:45.493476 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37514. Jul 26 05:09:13.287033 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:09:14.302957 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37570. Jul 26 05:09:25.817520 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:09:36.297908 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:09:37.618264 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:10:22.950024 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:10:23.967467 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37710. Jul 26 05:10:33.596004 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:10:33.634699 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:10:34.656170 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37738. Jul 26 05:11:09.440997 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:11:10.456944 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37806. Jul 26 05:11:13.449729 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:11:15.212668 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:11:34.686459 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:11:35.710410 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 37962. Jul 26 05:11:36.124142 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:11:36.143328 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.143725 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:36.190535 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.190851 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:36.191565 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.191955 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:36.207290 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Getting quotas for project 9e080ba686a54f19bc9ddb8b67dba1b9. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:11:36.211541 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Getting quotas for user d4060718dc2046e2885952b973e0f729 and project 9e080ba686a54f19bc9ddb8b67dba1b9. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:11:36.221661 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] [instance: e674f9c3-efa0-4eba-8a70-69807ee0fa84] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:11:36.222531 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.222931 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:36.228883 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] [instance: e674f9c3-efa0-4eba-8a70-69807ee0fa84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:11:36.230033 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.230429 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:36.254992 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:36.255396 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-344b89c6-aec3-4c87-a19c-99a3756c7536 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:45.496001 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:11:45.975908 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:11:45.994273 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:45.994676 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.036963 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:46.037376 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.038111 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:46.038510 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.053424 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Getting quotas for project 9e080ba686a54f19bc9ddb8b67dba1b9. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:11:46.058444 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Getting quotas for user d4060718dc2046e2885952b973e0f729 and project 9e080ba686a54f19bc9ddb8b67dba1b9. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:11:46.068984 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] [instance: b83bf1df-c7fe-4424-aa52-1a38cdde288a] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:11:46.069873 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:46.070267 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.076880 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] [instance: b83bf1df-c7fe-4424-aa52-1a38cdde288a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:11:46.078155 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:46.078551 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.103096 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:11:46.103512 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-f7ff1a99-12fe-421f-a740-b9d29bad6626 tempest-ServersNegativeTestJSON-351909971 tempest-ServersNegativeTestJSON-351909971-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:11:46.511822 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38024. Jul 26 05:12:30.599698 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:12:30.620256 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.620817 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:30.677017 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.677505 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:30.678303 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.678765 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:30.694623 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Getting quotas for project 6096a4430f7a4b4b997a75cbf1de767f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:12:30.699696 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Getting quotas for user 943ec62dccdb4fb5b018a85c090c65b1 and project 6096a4430f7a4b4b997a75cbf1de767f. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:12:30.711385 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] [instance: 9aa511f2-6899-48b1-ab1e-ef897a9ebfa6] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:12:30.712343 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.712810 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:30.719707 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] [instance: 9aa511f2-6899-48b1-ab1e-ef897a9ebfa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:12:30.721729 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.722193 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:30.750171 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:12:30.750533 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-bca2734a-8b42-4da9-8590-83ac032d2c6b tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:12:45.834322 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:13:05.413476 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:13:05.432151 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.432597 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:05.475241 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.475594 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:05.476304 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.476783 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:05.491880 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Getting quotas for project 6096a4430f7a4b4b997a75cbf1de767f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:13:05.496212 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Getting quotas for user 943ec62dccdb4fb5b018a85c090c65b1 and project 6096a4430f7a4b4b997a75cbf1de767f. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:13:05.506623 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] [instance: b0d4921a-69ff-4dab-a039-cd4dc2bf36bd] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:13:05.507508 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.507909 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:05.513957 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] [instance: b0d4921a-69ff-4dab-a039-cd4dc2bf36bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:13:05.515093 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.515499 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:05.539456 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:13:05.539994 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-20474f3c-4d8f-4069-8097-826edc883e1d tempest-TestEncryptedCinderVolumes-1059380699 tempest-TestEncryptedCinderVolumes-1059380699-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:13:23.966908 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:13:24.983129 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38540. Jul 26 05:13:53.613218 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:14:05.978717 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Took 0.21 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:14:05.996710 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:05.997122 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:06.053158 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:06.053479 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:06.054190 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:06.054574 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:06.069095 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Getting quotas for project eb8defc2b2bf4971a3e3af16325d59e0. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:14:06.073644 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Getting quotas for user daa59a06849344e8bdcf3032450a3108 and project eb8defc2b2bf4971a3e3af16325d59e0. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:14:06.084603 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] [instance: ba6f1284-5d41-4a62-8e40-089c8dc6bf95] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:14:06.085475 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:06.085870 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:06.091966 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] [instance: ba6f1284-5d41-4a62-8e40-089c8dc6bf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0efc66d-20e8-4d52-90cb-fc36f2deeb85',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:14:06.093126 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:06.093521 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:06.118043 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:14:06.118441 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-dd7fcc0b-a05e-4ff2-a787-c15ddf05cb3a tempest-TestMinimumBasicScenario-1691415618 tempest-TestMinimumBasicScenario-1691415618-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:14:46.513337 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:14:47.529857 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38916. Jul 26 05:15:14.307032 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:15:15.323960 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38952. Jul 26 05:15:35.705005 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:15:36.726069 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 38954. Jul 26 05:16:05.850774 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:16:09.143111 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Took 0.26 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:16:09.163831 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.164619 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:09.222845 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.223137 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:09.223800 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.224198 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:09.240198 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:16:09.244725 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for user cf1e52208c3a430b9bb1ca1a0c821030 and project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:16:09.255743 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: bb8adfd6-189d-4ec1-83a0-e9d893f9bfda] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:16:09.256731 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.257147 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:09.264965 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: bb8adfd6-189d-4ec1-83a0-e9d893f9bfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:16:09.266082 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.266495 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:09.295029 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:16:09.295628 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-db6301b7-d3a4-4ebb-b19f-512ca5ff43bb tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:16:16.317673 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:16:17.637432 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:16:24.983961 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:16:26.000008 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39226. Jul 26 05:17:08.030566 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Took 0.40 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:17:08.052051 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.052354 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:08.105504 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.105901 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:08.108635 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.109172 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:08.126643 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:17:08.131526 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for user cf1e52208c3a430b9bb1ca1a0c821030 and project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:17:08.142929 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: 3d6d1f96-a852-4510-b78a-70782b619979] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:17:08.144028 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.144702 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:08.154072 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: 3d6d1f96-a852-4510-b78a-70782b619979] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:17:08.155554 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.155907 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:08.191124 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:17:08.191530 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-8ee1f3cb-86e6-4f26-b5f3-569b107c87b0 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:17:13.632264 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:17:47.531219 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:17:48.547774 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39400. Jul 26 05:18:10.461980 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:18:11.478715 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39444. Jul 26 05:18:34.656059 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:18:35.678259 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39454. Jul 26 05:18:55.200835 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Took 0.31 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:18:55.225106 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.225524 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:18:55.276076 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.276633 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:18:55.277365 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.277759 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:18:55.293557 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:18:55.298259 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for user cf1e52208c3a430b9bb1ca1a0c821030 and project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:18:55.309350 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: e3f49609-2185-431f-9086-e54741b0444d] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:18:55.310299 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.310703 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:18:55.321034 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: e3f49609-2185-431f-9086-e54741b0444d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:18:55.322334 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.322743 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:18:55.350312 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:18:55.351012 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-178ded6b-7b50-4767-b329-60b82522a7c8 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:19:25.877191 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:19:26.000541 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:19:27.017226 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39608. Jul 26 05:19:39.277259 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method migrate_server {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 05:19:39.277745 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:19:39.278148 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:19:39.408959 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: e3f49609-2185-431f-9086-e54741b0444d] Restricting to cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) while migrating {{(pid=99991) _set_requested_destination_cell /opt/stack/nova/nova/conductor/tasks/migrate.py:210}} Jul 26 05:19:39.679041 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Created allocations for migration caee465b-3878-459c-9d2c-e88861c59ea9 on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) replace_allocation_with_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:86}} Jul 26 05:19:40.025495 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: e3f49609-2185-431f-9086-e54741b0444d] Calling prep_resize with selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [Selection(allocation_request='{"allocations": {"c88f8435-9d4d-41fb-83fa-eae02604b075": {"resources": {"DISK_GB": 1, "MEMORY_MB": 512, "VCPU": 1}}}, "mappings": {"": ["c88f8435-9d4d-41fb-83fa-eae02604b075"]}}',allocation_request_version='1.35',availability_zone='nova',cell_uuid=cdbe4959-2833-4606-a027-7c38eb82690c,compute_node_uuid=c88f8435-9d4d-41fb-83fa-eae02604b075,limits=SchedulerLimits,nodename='n-h1-802225-1',service_host='n-h1-802225-1')] {{(pid=99991) _execute /opt/stack/nova/nova/conductor/tasks/migrate.py:317}} Jul 26 05:19:40.178890 n-d-802225-1 nova-conductor[99991]: DEBUG nova.scheduler.client.report [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Overwriting current allocation {'allocations': {'89921da4-8192-4609-a428-d99fff8e0658': {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}, 'generation': 205}}, 'project_id': '0f0b879023f141ef9ce91d821e91a30a', 'user_id': 'cf1e52208c3a430b9bb1ca1a0c821030', 'consumer_generation': 1} on consumer e3f49609-2185-431f-9086-e54741b0444d {{(pid=99991) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:1963}} Jul 26 05:19:40.250902 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.tasks.migrate [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Created allocations for instance e3f49609-2185-431f-9086-e54741b0444d on c88f8435-9d4d-41fb-83fa-eae02604b075 {{(pid=99991) revert_allocation_for_migration /opt/stack/nova/nova/conductor/tasks/migrate.py:109}} Jul 26 05:19:40.277294 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Failed to compute_task_migrate_server: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:19:40.278426 n-d-802225-1 nova-conductor[99991]: WARNING nova.scheduler.utils [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: e3f49609-2185-431f-9086-e54741b0444d] Setting instance to ACTIVE state. Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server [None req-48c4d403-4e51-4f5e-ac94-e5d2c801abca tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Exception during message handling: TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 241, in inner Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 97, in wrapper Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return fn(self, context, *args, **kwargs) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/utils.py", line 1433, in decorated_function Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs) Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 298, in migrate_server Jul 26 05:19:40.360330 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self._cold_migrate(context, instance, flavor, Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 394, in _cold_migrate Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server LOG.info('During %s the instance was deleted.', Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/manager.py", line 353, in _cold_migrate Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server task.execute() Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 26, in wrap Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.rollback(ex) Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.force_reraise() Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server raise self.value Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 23, in wrap Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return original(self) Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/base.py", line 40, in execute Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server return self._execute() Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/conductor/tasks/migrate.py", line 321, in _execute Jul 26 05:19:40.361943 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server self.compute_rpcapi.prep_resize( Jul 26 05:19:40.363575 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server TypeError: prep_resize() got an unexpected keyword argument 'copy_pmem_devices' Jul 26 05:19:40.363575 n-d-802225-1 nova-conductor[99991]: ERROR oslo_messaging.rpc.server Jul 26 05:20:48.549038 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:20:49.566751 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39800. Jul 26 05:21:15.235624 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:21:15.328118 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:21:16.339359 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:21:16.354955 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39852. Jul 26 05:21:17.654483 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:21:36.725005 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:21:37.748821 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39902. Jul 26 05:22:11.481058 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:22:12.499250 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 39964. Jul 26 05:22:13.649564 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:22:27.017836 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:22:28.033269 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40000. Jul 26 05:22:35.676409 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:22:36.698279 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40026. Jul 26 05:22:45.893606 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:22:53.473956 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:23:49.567012 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:23:50.584292 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40176. Jul 26 05:24:16.356077 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:24:17.373591 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40232. Jul 26 05:24:35.251600 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:24:36.358078 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:24:37.670217 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:24:37.744241 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:24:38.764374 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40284. Jul 26 05:25:12.499200 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:25:13.515332 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40352. Jul 26 05:25:28.035547 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:25:29.051969 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40384. Jul 26 05:25:33.664830 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:25:36.694052 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:25:37.715470 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40410. Jul 26 05:25:53.558701 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Took 0.32 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:25:53.578831 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.579315 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:25:53.624137 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.624710 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:25:53.625311 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.625728 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:25:53.641364 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:25:53.646442 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for user cf1e52208c3a430b9bb1ca1a0c821030 and project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:25:53.657002 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: 3b31f51c-7896-4648-bd29-a6553ea8cd4c] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:25:53.657944 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.658359 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:25:53.665188 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: 3b31f51c-7896-4648-bd29-a6553ea8cd4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:25:53.666380 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.666787 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:25:53.693899 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:25:53.694349 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-03e55e15-5e1c-4b0f-a8bb-346613a948e3 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:26:05.910287 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:26:13.489464 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:26:50.585235 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:26:51.600918 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40600. Jul 26 05:27:39.727654 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Took 0.29 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:27:39.747917 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.748335 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.793784 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.794281 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.795064 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.795520 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.810432 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:27:39.815297 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Getting quotas for user cf1e52208c3a430b9bb1ca1a0c821030 and project 0f0b879023f141ef9ce91d821e91a30a. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:27:39.826632 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: fd878080-0370-463a-8c8d-f1502e8decaa] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:27:39.827560 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.827975 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.834646 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [instance: fd878080-0370-463a-8c8d-f1502e8decaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:27:39.836728 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.837175 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.863679 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:27:39.864175 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:27:39.874627 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [5bec7749-908e-4152-b710-0bde5ccf1fe4] AMQP server on 10.222.0.22:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 05:27:40.901402 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [None req-50f78707-5fb8-4f06-b240-39a386f08773 tempest-TestNetworkAdvancedServerOps-1905974392 tempest-TestNetworkAdvancedServerOps-1905974392-project] [5bec7749-908e-4152-b710-0bde5ccf1fe4] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40730. Jul 26 05:28:17.376029 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:28:18.392877 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40778. Jul 26 05:28:29.053625 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:28:30.069783 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40818. Jul 26 05:28:38.764229 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:28:39.790275 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 40858. Jul 26 05:28:53.263300 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Took 0.23 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:28:53.281748 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.282153 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.331594 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.332002 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.332766 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.333164 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.347472 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Getting quotas for project 0c2fb40c27544ca4a49fef22277efdb6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:28:53.352078 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Getting quotas for user 62d6214741d949d8a08d1ccfe04363a3 and project 0c2fb40c27544ca4a49fef22277efdb6. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:28:53.362648 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: a43c0568-8d31-40c8-b584-95312839cce7] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:28:53.363567 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.363971 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.371660 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: a43c0568-8d31-40c8-b584-95312839cce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:28:53.372858 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.373260 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.406378 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:28:53.407045 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f608f296-679b-48fe-8d1a-390f68b7e895 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:28:53.680804 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:29:25.928154 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:29:51.601804 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:29:52.618312 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41050. Jul 26 05:31:13.507968 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:31:13.520902 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:31:14.546429 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41162. Jul 26 05:31:16.376779 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:31:17.694163 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:31:18.395099 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:31:19.414958 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41184. Jul 26 05:31:24.340888 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method unshelve_instance {{(pid=99992) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 05:31:24.341462 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:31:24.341729 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:31:24.776250 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: a43c0568-8d31-40c8-b584-95312839cce7] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) during scheduling {{(pid=99992) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jul 26 05:31:25.150366 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Took 0.37 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:31:25.155733 n-d-802225-1 nova-conductor[99992]: DEBUG nova.objects.instance [None req-9d672bdb-f2fd-4677-84e9-bc41975983f8 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lazy-loading 'flavor' on Instance uuid a43c0568-8d31-40c8-b584-95312839cce7 {{(pid=99992) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 05:31:30.071028 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:31:31.087993 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41276. Jul 26 05:31:37.715037 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:31:38.735903 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41294. Jul 26 05:32:13.700238 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:32:45.944450 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:32:52.619021 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:32:53.635577 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41372. Jul 26 05:33:11.320963 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Took 0.19 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:33:11.339832 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.340238 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:33:11.382175 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.382504 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:33:11.383223 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.383613 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:33:11.398287 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Getting quotas for project 0c2fb40c27544ca4a49fef22277efdb6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:33:11.402714 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Getting quotas for user 62d6214741d949d8a08d1ccfe04363a3 and project 0c2fb40c27544ca4a49fef22277efdb6. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:33:11.413519 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: 49b92cc7-ffe2-4c9c-92d9-675bfb67a03a] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:33:11.414393 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.414794 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:33:11.421166 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: 49b92cc7-ffe2-4c9c-92d9-675bfb67a03a] block_device_mapping [BlockDeviceMapping(attachment_id=e91c0b1f-0735-44e5-923f-66620e796fc9,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06a029df-8c37-4f9b-8ce2-53f6f1e939c7',volume_size=1,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:33:11.422407 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.422801 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:33:11.448704 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:33:11.449117 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a8a41a5-637c-4205-a6a8-31c1131b613b tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:34:14.543118 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:34:15.559598 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41614. Jul 26 05:34:31.088127 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:34:32.105767 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41620. Jul 26 05:34:33.528670 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:34:35.276172 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:34:38.732000 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:34:39.753955 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41628. Jul 26 05:35:19.416800 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:35:20.432935 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41634. Jul 26 05:35:33.716909 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:35:39.787429 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:35:40.502592 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Targeting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) for conductor method unshelve_instance {{(pid=99991) wrapper /opt/stack/nova/nova/conductor/manager.py:90}} Jul 26 05:35:40.503074 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:35:40.503471 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:35:40.636838 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] [instance: 49b92cc7-ffe2-4c9c-92d9-675bfb67a03a] Requesting cell cdbe4959-2833-4606-a027-7c38eb82690c(cell1) during scheduling {{(pid=99991) _restrict_request_spec_to_cell /opt/stack/nova/nova/conductor/manager.py:902}} Jul 26 05:35:40.808557 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41706. Jul 26 05:35:42.894517 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Took 2.25 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:35:42.900291 n-d-802225-1 nova-conductor[99991]: DEBUG nova.objects.instance [None req-f92dfdf4-3920-4d23-95fc-4ceb2d48d747 tempest-TestShelveInstance-367537872 tempest-TestShelveInstance-367537872-project] Lazy-loading 'flavor' on Instance uuid 49b92cc7-ffe2-4c9c-92d9-675bfb67a03a {{(pid=99991) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 26 05:35:53.637120 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:35:54.653747 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41742. Jul 26 05:36:05.961083 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:36:16.399762 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:36:17.710138 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:37:32.106829 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:37:33.127997 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 41902. Jul 26 05:37:37.466020 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Took 0.51 seconds to select destinations for 1 instance(s). {{(pid=99991) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:37:37.484366 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.485026 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:37:37.539148 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.539548 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:37:37.540323 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.540761 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:37:37.558458 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Getting quotas for project f26a267c9a9f4449957417bf9bc617b3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:37:37.563008 n-d-802225-1 nova-conductor[99991]: DEBUG nova.quota [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Getting quotas for user 316b807f20c74e879bebcbd018028355 and project f26a267c9a9f4449957417bf9bc617b3. Resources: {'cores', 'instances', 'ram'} {{(pid=99991) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:37:37.574819 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] [instance: 8c825cdc-234f-4f7a-9e1f-660b35129a3d] Selected host: n-h2-802225-1; Selected node: n-h2-802225-1; Alternates: [('n-h1-802225-1', 'n-h1-802225-1')] {{(pid=99991) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:37:37.575757 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.576172 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:37:37.583273 n-d-802225-1 nova-conductor[99991]: DEBUG nova.conductor.manager [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] [instance: 8c825cdc-234f-4f7a-9e1f-660b35129a3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2039f4c5-ff42-44ef-b683-b45773657564',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99991) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:37:37.584592 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.584996 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:37:37.613365 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:37:37.613778 n-d-802225-1 nova-conductor[99991]: DEBUG oslo_concurrency.lockutils [None req-eaabd404-e9bd-49e7-833c-be814eb98fc0 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99991) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:38:20.434003 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:38:21.449916 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42006. Jul 26 05:38:40.805278 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:38:41.826662 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42016. Jul 26 05:38:53.736206 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:38:54.654778 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:38:55.671380 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42020. Jul 26 05:39:25.976956 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:39:36.416717 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:39:37.726609 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:39:39.752274 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:39:40.774274 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42034. Jul 26 05:39:58.654536 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Took 0.20 seconds to select destinations for 1 instance(s). {{(pid=99992) _schedule_instances /opt/stack/nova/nova/conductor/manager.py:884}} Jul 26 05:39:58.673786 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.674188 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:39:58.732815 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.733170 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:39:58.733893 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.734286 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:39:58.748606 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Getting quotas for project f26a267c9a9f4449957417bf9bc617b3. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 26 05:39:58.753118 n-d-802225-1 nova-conductor[99992]: DEBUG nova.quota [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Getting quotas for user 316b807f20c74e879bebcbd018028355 and project f26a267c9a9f4449957417bf9bc617b3. Resources: {'cores', 'instances', 'ram'} {{(pid=99992) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 26 05:39:58.766859 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] [instance: d5335a11-3a35-498b-a334-0e9ec239766d] Selected host: n-h1-802225-1; Selected node: n-h1-802225-1; Alternates: [('n-h2-802225-1', 'n-h2-802225-1')] {{(pid=99992) schedule_and_build_instances /opt/stack/nova/nova/conductor/manager.py:1628}} Jul 26 05:39:58.767802 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.768210 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:39:58.775065 n-d-802225-1 nova-conductor[99992]: DEBUG nova.conductor.manager [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] [instance: d5335a11-3a35-498b-a334-0e9ec239766d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6e4ef31f-912b-47b7-886a-54e57af0d80d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=99992) _create_block_device_mapping /opt/stack/nova/nova/conductor/manager.py:1372}} Jul 26 05:39:58.776388 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.776821 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:39:58.802161 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 26 05:39:58.802577 n-d-802225-1 nova-conductor[99992]: DEBUG oslo_concurrency.lockutils [None req-6a220327-1136-4a1a-873e-4e4a92421597 tempest-TestSnapshotPattern-418616603 tempest-TestSnapshotPattern-418616603-project] Lock "cdbe4959-2833-4606-a027-7c38eb82690c" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=99992) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 26 05:40:15.563544 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:40:16.581437 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42272. Jul 26 05:40:33.129456 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:40:34.145067 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42288. Jul 26 05:41:55.672293 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:41:56.690464 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42404. Jul 26 05:42:13.752764 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:42:21.452046 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:42:22.470627 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42594. Jul 26 05:42:40.770082 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:42:41.790666 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42598. Jul 26 05:42:41.825543 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:42:42.846437 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42600. Jul 26 05:42:45.993331 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:42:53.549628 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:42:55.296828 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:42:56.433364 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:42:57.742224 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:43:16.581125 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:43:17.597551 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42622. Jul 26 05:43:34.145871 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:43:35.161512 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42624. Jul 26 05:44:56.689949 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:44:57.705724 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42638. Jul 26 05:45:22.470952 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:45:23.487362 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42644. Jul 26 05:45:33.769406 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:45:41.786945 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:45:42.808022 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42654. Jul 26 05:45:42.842947 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:45:43.867683 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42656. Jul 26 05:46:06.009230 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:46:13.565129 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:46:15.312174 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:46:16.448829 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:46:17.598959 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:46:17.757504 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:46:18.614589 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42676. Jul 26 05:46:35.162862 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:46:36.179644 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42678. Jul 26 05:47:57.706678 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:47:58.722439 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [6912717f-9d36-46c5-91d8-f3042aa00337] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42688. Jul 26 05:48:23.488011 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:48:24.504990 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [d772850c-d404-434e-b3d1-dc7766fedc67] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42694. Jul 26 05:48:42.803742 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:48:43.824673 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [46589afb-e918-4f83-b368-c0fcf40919fb] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42700. Jul 26 05:48:43.863891 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] AMQP server on 10.222.0.22:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 26 05:48:44.885647 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [f94fcc70-cb03-408a-b498-8a021341a058] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42702. Jul 26 05:48:53.785507 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:49:18.616041 n-d-802225-1 nova-conductor[99991]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:49:19.632632 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] [2248b3e3-d35e-4344-aaa2-d45a4acdf6ef] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42706. Jul 26 05:49:26.025224 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:49:33.581060 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:49:35.327884 n-d-802225-1 nova-conductor[99991]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:49:36.180979 n-d-802225-1 nova-conductor[99992]: ERROR oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] AMQP server on 10.222.0.22:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 26 05:49:36.464614 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 05:49:37.196049 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] [713e1f93-7413-450d-9224-82d473bbc2d3] Reconnected to AMQP server on 10.222.0.22:5672 via [amqp] client with port 42724. Jul 26 05:49:37.773678 n-d-802225-1 nova-conductor[99992]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer